trove.su
robots.txt
Robots Exclusion Standard data for trove.su
Resource Scan
Scan Details
Site Domain | trove.su |
Base Domain | trove.su |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-31T01:34:40+00:00 |
Next Scan | 2024-11-01T01:34:40+00:00 |
Last Successful Scan
Scanned | 2024-10-24T01:34:17+00:00 |
URL | https://trove.su/robots.txt |
Domain IPs | 104.21.58.14, 172.67.197.50, 2606:4700:3033::6815:3a0e, 2606:4700:3035::ac43:c532 |
Response IP | 104.21.58.14 |
Found | Yes |
Hash | bfbde98f7102ec44265a6de441d4e58df4d332a27e5e8e5a82ac8a45a5b03ea4 |
SimHash | 3c18ae22bc95 |
Groups
*
Rule | Path |
---|---|
Disallow | /register.html |
Disallow | /attachments/ |
Disallow | /birthdays/ |
Disallow | /find-new/ |
Disallow | /forums/*/?direction |
Disallow | /forums/*/?order |
Disallow | /forums/*/page-*?order |
Disallow | /help/ |
Disallow | /login/ |
Disallow | /lost-password/ |
Disallow | /members/ |
Disallow | /misc/ |
Disallow | /online/ |
Disallow | /pages/privacy/ |
Disallow | /posts/ |
Disallow | /goto/ |
Disallow | /recent-activity/ |
Disallow | /register |
Disallow | /search/ |
Disallow | /tags/ |
Disallow | /search.php |
Disallow | /resources/ |
Disallow | /threads/*/poll |
Disallow | /WhoHasVisited/ |
Disallow | /mods/?order |
Disallow | /mods/*/download?version |
Disallow | /mods/*/history |
Disallow | /mods/*/update?resource_update_id |
Disallow | /mods/authors/ |
Disallow | /mods/categories/*/?order |
Disallow | /mods/?page |
Disallow | /mods/categories/ |
Other Records
Field | Value |
---|---|
sitemap | https://trove.su/sitemap.php |
Warnings
- `host` is not a known field.