Log In Sign Up

goodgym.org
robots.txt

Robots Exclusion Standard data for goodgym.org

Resource Scan

Scan Details

Site Domain goodgym.org
Base Domain goodgym.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-18T10:46:24+00:00
Next Scan 2024-06-16T10:46:24+00:00

Last Successful Scan

Scanned2023-07-29T00:35:44+00:00
URL https://www.goodgym.org/robots.txt
Domain IPs 54.192.150.111, 54.192.150.126, 54.192.150.9, 54.192.150.94
Response IP 13.32.27.111
Found Yes
Hash 8f24968e026f5b1ba3fd2930a5954cb35f3496d9e7d7a3e8f38c4836da977d1c
SimHash b2956d0d6450

Groups

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top