thing.org
robots.txt
Robots Exclusion Standard data for thing.org
Resource Scan
Scan Details
Site Domain | thing.org |
Base Domain | thing.org |
Scan Status | Ok |
Last Scan | 2024-11-11T11:07:30+00:00 |
Next Scan | 2024-12-11T11:07:30+00:00 |
Last Scan
Scanned | 2024-11-11T11:07:30+00:00 |
URL | https://thing.org/robots.txt |
Domain IPs | 2a01:30:0:13:5054:ffaa:fbb4:a9da, 83.223.85.195 |
Response IP | 83.223.85.195 |
Found | Yes |
Hash | 555b88b9f494db6b108b1217def74747df5f112e46167e37d13ea84ae6bf7f47 |
SimHash | a811d94be998 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /cyberworld/map/ | This is an infinite virtual URL space |
Disallow | /tmp/ | these will soon disappear |
Comments