girlscoutshop.com
robots.txt

Robots Exclusion Standard data for girlscoutshop.com

Resource Scan

Scan Details

Site Domain girlscoutshop.com
Base Domain girlscoutshop.com
Scan Status Ok
Last Scan2024-10-18T12:06:05+00:00
Next Scan 2024-11-17T12:06:05+00:00

Last Scan

Scanned2024-10-18T12:06:05+00:00
URL https://www.girlscoutshop.com/robots.txt
Domain IPs 125.56.219.17, 23.32.29.97
Response IP 125.56.219.17
Found Yes
Hash 10e597ec5d16ed6980ab3e0aee42d95bea86d4f6c2a785b72d10cf5bbabd96b1
SimHash 2a3e8823c327

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.girlscoutshop.com/sitemap_www.girlscoutshop.com_Index.xml

Comments

  • Change Disallow to this when going to production:
  • Disallow: /shopflow/
  • And remove the Crawl-Delay entry