trove.su
robots.txt

Robots Exclusion Standard data for trove.su

Resource Scan

Scan Details

Site Domain trove.su
Base Domain trove.su
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-31T01:34:40+00:00
Next Scan 2024-11-01T01:34:40+00:00

Last Successful Scan

Scanned2024-10-24T01:34:17+00:00
URL https://trove.su/robots.txt
Domain IPs 104.21.58.14, 172.67.197.50, 2606:4700:3033::6815:3a0e, 2606:4700:3035::ac43:c532
Response IP 104.21.58.14
Found Yes
Hash bfbde98f7102ec44265a6de441d4e58df4d332a27e5e8e5a82ac8a45a5b03ea4
SimHash 3c18ae22bc95

Groups

*

Rule Path
Disallow /register.html
Disallow /attachments/
Disallow /birthdays/
Disallow /find-new/
Disallow /forums/*/?direction
Disallow /forums/*/?order
Disallow /forums/*/page-*?order
Disallow /help/
Disallow /login/
Disallow /lost-password/
Disallow /members/
Disallow /misc/
Disallow /online/
Disallow /pages/privacy/
Disallow /posts/
Disallow /goto/
Disallow /recent-activity/
Disallow /register
Disallow /search/
Disallow /tags/
Disallow /search.php
Disallow /resources/
Disallow /threads/*/poll
Disallow /WhoHasVisited/
Disallow /mods/?order
Disallow /mods/*/download?version
Disallow /mods/*/history
Disallow /mods/*/update?resource_update_id
Disallow /mods/authors/
Disallow /mods/categories/*/?order
Disallow /mods/?page
Disallow /mods/categories/

Other Records

Field Value
sitemap https://trove.su/sitemap.php

Warnings

  • `host` is not a known field.