Log In Sign Up

watermark.drivethrurpg.com
robots.txt

Robots Exclusion Standard data for watermark.drivethrurpg.com

Resource Scan

Scan Details

Site Domain watermark.drivethrurpg.com
Base Domain drivethrurpg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-29T08:05:44+00:00
Next Scan 2026-01-27T08:05:44+00:00

Last Successful Scan

Scanned2024-12-11T01:39:58+00:00
URL https://watermark.drivethrurpg.com/robots.txt
Domain IPs 104.26.2.2, 104.26.3.2, 172.67.69.128, 2606:4700:20::681a:202, 2606:4700:20::681a:302, 2606:4700:20::ac43:4580
Response IP 104.26.2.2
Found Yes
Hash 6af9730263fa1a7ad456e9ad6e09c64babda7669c3643fdd050c6c1b5f677a6c
SimHash aa78954feef6

Groups

*

Rule Path
Allow /
Back to top

Comments

  • Our production robots.txt file; this robots.txt is extremely permissive because the damage that
  • can be done to the site by excluding important bots that drive our SEO rankings far outweights
  • the impact of any given misbehaving bots we are currently aware of. Future exclusions may be
  • added as needed.
  • It is for sites that have taken over a top level domain.
Back to top