snackszones.com
robots.txt

Robots Exclusion Standard data for snackszones.com

Resource Scan

Scan Details

Site Domain snackszones.com
Base Domain snackszones.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-06-23T06:24:39+00:00
Next Scan 2024-07-07T06:24:39+00:00

Last Successful Scan

Scanned2024-06-08T06:24:25+00:00
URL https://snackszones.com/robots.txt
Domain IPs 67.223.118.63
Response IP 67.223.118.63
Found Yes
Hash 78d33c1b2cb073d9f30bc9214fdc5eac8c4e33b4965e03a9051859ba7fffb740
SimHash 4d60d73657f6

Groups

googlebot
googlebot-mobile
adsbot-google
googlebot-image
mediapartners
mediapartners-google
googlebot-news
googlebot-video

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

slurp

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

Other Records

Field Value
crawl-delay 10

yandex
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
yandexpagechecker

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

dotbot
rogerbot

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://snackszones.com/sitemap_index.xml
sitemap https://snackszones.com/post-sitemap1.xml
sitemap https://snackszones.com/post-sitemap2.xml
sitemap https://snackszones.com/post-sitemap3.xml
sitemap https://snackszones.com/page-sitemap.xml
sitemap https://snackszones.com/category-sitemap.xml

Comments

  • Google Bots
  • slow down Yahoo
  • Slow Down Bing Bot
  • Yandex Bot
  • Moz Bot