twistermc.com
robots.txt
Robots Exclusion Standard data for twistermc.com
Resource Scan
Scan Details
Site Domain | twistermc.com |
Base Domain | twistermc.com |
Scan Status | Ok |
Last Scan | 2024-11-14T11:31:03+00:00 |
Next Scan | 2024-11-15T11:31:03+00:00 |
Last Scan
Scanned | 2024-11-14T11:31:03+00:00 |
URL | https://twistermc.com/robots.txt |
Domain IPs | 104.21.83.208, 172.67.181.241, 2606:4700:3033::ac43:b5f1, 2606:4700:3037::6815:53d0 |
Response IP | 172.67.181.241 |
Found | Yes |
Hash | 994614bc97ad860a4f4089afb4403ceb2e50e9425d39a20edf77fd7df61a9e0c |
SimHash | d8107f40eb92 |
Groups
*
Rule | Path |
---|---|
Disallow | /stats/ |
Disallow | /downloads/ |
Disallow | /deliciouslibrary/ |
Disallow | /twister/iCal/ |
Disallow | /board/ |
Disallow | /temp/ |
Disallow | /mantis/ |
Disallow | /twist/upload/ |
Disallow | /quiet/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.twistermc.com/christi/sitemap_index.xml |
sitemap | http://www.twistermc.com/sitemap_index.xml |
Comments