tankathon.com
robots.txt

Robots Exclusion Standard data for tankathon.com

Resource Scan

Scan Details

Site Domain tankathon.com
Base Domain tankathon.com
Scan Status Ok
Last Scan2024-11-12T12:09:40+00:00
Next Scan 2024-11-19T12:09:40+00:00

Last Scan

Scanned2024-11-12T12:09:40+00:00
URL https://tankathon.com/robots.txt
Domain IPs 13.248.132.87, 35.71.145.101, 75.2.97.79, 99.83.151.71
Response IP 35.71.145.101
Found Yes
Hash ae03d0e41a65f7a1f2077b27a039244757fdae73106ca5de55eefdfd8e0fe229
SimHash a28529ad6450

Groups

gptbot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /