Log In Sign Up

mysay.com
robots.txt

Robots Exclusion Standard data for mysay.com

Resource Scan

Scan Details

Site Domain mysay.com
Base Domain mysay.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-03T14:33:29+00:00
Next Scan 2025-01-01T14:33:29+00:00

Last Successful Scan

Scanned2023-11-16T14:27:59+00:00
URL https://mysay.com/robots.txt
Domain IPs 107.21.219.43
Response IP 107.21.219.43
Found Yes
Hash eec27d6de89add5b84458b40c719f52ef54409c9554ad3533836049d14492a64
SimHash ba840d8d6370

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top