prsa.org
robots.txt

Robots Exclusion Standard data for prsa.org

Resource Scan

Scan Details

Site Domain prsa.org
Base Domain prsa.org
Scan Status Ok
Last Scan2025-10-11T19:33:22+00:00
Next Scan 2025-11-10T19:33:22+00:00

Last Scan

Scanned2025-10-11T19:33:22+00:00
URL https://prsa.org/robots.txt
Redirect https://www.prsa.org:443/robots.txt
Redirect Domain www.prsa.org
Redirect Base prsa.org
Domain IPs 3.220.41.178
Redirect IPs 3.227.30.253, 34.228.49.7
Response IP 34.228.49.7
Found Yes
Hash 424751c5ac48c258b92f4bf1e848f074a886e8f26e414d8b2d0b3043e464b283
SimHash 6915d9754ff1

Groups

*

Rule Path
Disallow /Sitefinity
Disallow /sandbox
Disallow /search-results
Disallow /Reference

Other Records

Field Value
crawl-delay 120

Comments

  • Do not delete /Sitefinity or /Sandbox. Never any reason to allow indexing here
  • The same goes for sandbox
  • Also disallow search. We already have it set to "noindex", but keep getting googlebot hits