shermansmiles.com
robots.txt

Robots Exclusion Standard data for shermansmiles.com

Resource Scan

Scan Details

Site Domain shermansmiles.com
Base Domain shermansmiles.com
Scan Status Ok
Last Scan2026-01-08T23:35:54+00:00
Next Scan 2026-02-07T23:35:54+00:00

Last Scan

Scanned2026-01-08T23:35:54+00:00
URL https://shermansmiles.com/robots.txt
Redirect https://www.shermansmiles.com/robots.txt
Redirect Domain www.shermansmiles.com
Redirect Base shermansmiles.com
Domain IPs 104.21.8.16, 172.67.130.91, 2606:4700:3030::6815:810, 2606:4700:3035::ac43:825b
Redirect IPs 104.21.8.16, 172.67.130.91, 2606:4700:3030::6815:810, 2606:4700:3035::ac43:825b
Response IP 104.21.8.16
Found Yes
Hash d2005b33857d27c5a12572e790400b360ed205ed67843ca13b87cc5085fb5437
SimHash b2852d8d6550

Groups

*

Rule Path
Disallow

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: