sugarmtnfarm.com
robots.txt

Robots Exclusion Standard data for sugarmtnfarm.com

Resource Scan

Scan Details

Site Domain sugarmtnfarm.com
Base Domain sugarmtnfarm.com
Scan Status Ok
Last Scan2026-02-28T23:25:58+00:00
Next Scan 2026-03-07T23:25:58+00:00

Last Scan

Scanned2026-02-28T23:25:58+00:00
URL https://sugarmtnfarm.com/robots.txt
Domain IPs 69.57.162.28
Response IP 69.57.162.28
Found Yes
Hash 2ed76a1ac7e085f58a2bd2daba6dc7e862bd9eaa160ebf7a3cde8a00ddd04817
SimHash 6940988157b5

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

mediapartners-google*

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

*

Rule Path
Disallow */cgi-bin/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap http://SugarMtnFarm.com/sitemap.xml

Comments

  • SMF and other robot file - allow major indexing
  • robots.txt generated at http://www.mcanerin.com