thing.org
robots.txt

Robots Exclusion Standard data for thing.org

Resource Scan

Scan Details

Site Domain thing.org
Base Domain thing.org
Scan Status Ok
Last Scan2024-11-11T11:07:30+00:00
Next Scan 2024-12-11T11:07:30+00:00

Last Scan

Scanned2024-11-11T11:07:30+00:00
URL https://thing.org/robots.txt
Domain IPs 2a01:30:0:13:5054:ffaa:fbb4:a9da, 83.223.85.195
Response IP 83.223.85.195
Found Yes
Hash 555b88b9f494db6b108b1217def74747df5f112e46167e37d13ea84ae6bf7f47
SimHash a811d94be998

Groups

*

Rule Path Comment
Disallow /cyberworld/map/ This is an infinite virtual URL space
Disallow /tmp/ these will soon disappear

Comments

  • robots.txt for http://www.site.com/