Log In Sign Up

rpgnow.com
robots.txt

Robots Exclusion Standard data for rpgnow.com

Resource Scan

Scan Details

Site Domain rpgnow.com
Base Domain rpgnow.com
Scan Status Ok
Last Scan2025-03-22T11:53:39+00:00
Next Scan 2025-04-21T11:53:39+00:00

Last Scan

Scanned2025-03-22T11:53:39+00:00
URL https://rpgnow.com/robots.txt
Redirect https://www.drivethrurpg.com/robots.txt
Redirect Domain www.drivethrurpg.com
Redirect Base drivethrurpg.com
Domain IPs 104.21.46.111, 172.67.168.116, 2606:4700:3032::ac43:a874, 2606:4700:3037::6815:2e6f
Redirect IPs 3.143.66.25, 3.22.230.127
Response IP 3.22.230.127
Found Yes
Hash 6af9730263fa1a7ad456e9ad6e09c64babda7669c3643fdd050c6c1b5f677a6c
SimHash aa78954feef6

Groups

*

Rule Path
Allow /
Back to top

Comments

  • Our production robots.txt file; this robots.txt is extremely permissive because the damage that
  • can be done to the site by excluding important bots that drive our SEO rankings far outweights
  • the impact of any given misbehaving bots we are currently aware of. Future exclusions may be
  • added as needed.
  • It is for sites that have taken over a top level domain.
Back to top