murphdesignshirts.com
robots.txt

Robots Exclusion Standard data for murphdesignshirts.com

Resource Scan

Scan Details

Site Domain murphdesignshirts.com
Base Domain murphdesignshirts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-05T21:29:56+00:00
Next Scan 2025-01-03T21:29:56+00:00

Last Successful Scan

Scanned2021-10-18T18:11:35+00:00
URL https://www.murphdesignshirts.com/robots.txt
Found Yes
Hash a267b466b59bb16a837d6e7ebca1b4eff52ccf83bfd982f30f64af8d083421b7
SimHash a28d298d6470

Groups

*

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /