Log In Sign Up

bestanimationgif.com
robots.txt

Robots Exclusion Standard data for bestanimationgif.com

Resource Scan

Scan Details

Site Domain bestanimationgif.com
Base Domain bestanimationgif.com
Scan Status Ok
Last Scan2024-10-07T17:08:33+00:00
Next Scan 2024-10-14T17:08:33+00:00

Last Scan

Scanned2024-10-07T17:08:33+00:00
URL https://bestanimationgif.com/robots.txt
Domain IPs 104.21.96.39, 172.67.172.69, 2606:4700:3030::6815:6027, 2606:4700:3035::ac43:ac45
Response IP 104.21.96.39
Found Yes
Hash 79638a08b383b792ac5822a87e37de1a7798b99f793930f1e51068453524cf50
SimHash 4166b6d14239

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /blog
Disallow /forum
Disallow /pic.php?
Disallow /clipboard.swf?
Disallow /cards/category.php?
Disallow /cards/cards/card.php?
Disallow /gallery/mail
Disallow /gallery/audio
Disallow /gallery/main
Disallow /gallery/sitecodes
Disallow /users/gallery
Disallow /?cat=

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider/2.0

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /
Allow /images/*.jpg
Allow /images/*.png
Allow /images/*.gif
Back to top

Other Records

Field Value
sitemap http://bestanimationgif.com/sitemap.xml
sitemap http://bestanimationgif.com/sitemap_1.xml
sitemap http://bestanimationgif.com/sitemap_2.xml
sitemap http://bestanimationgif.com/sitemap_3.xml
sitemap http://bestanimationgif.com/sitemap_index.xml
Back to top

Comments

  • Allow: http://bs.yandex.ru/informer/24562853/1_0_EFEFEFFF_EFEFEFFF_0_uniques
  • Allow: http://mc.yandex.ru/metrika/watch.js
  • Allow: http://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js
  • Allow: http://d7.c4.b0.a2.top.mail.ru/counter?id=2115352;t=170;js=13;s=411*731;_=0.2755968610290438
  • Allow: http://bs.yandex.ru/informer/24562853/1_0_EFEFEFFF_EFEFEFFF_0_uniques
  • Allow: http://connect.ok.ru/connect.js
  • Allow: http://connect.mail.ru/js/loader.js
  • Allow: https://queuev4.vk.com/im872
Back to top

Warnings

  • `host` is not a known field.
Back to top