getpopfile.org
robots.txt

Robots Exclusion Standard data for getpopfile.org

Resource Scan

Scan Details

Site Domain getpopfile.org
Base Domain getpopfile.org
Scan Status Ok
Last Scan2025-11-13T22:25:36+00:00
Next Scan 2025-12-13T22:25:36+00:00

Last Scan

Scanned2025-11-13T22:25:36+00:00
URL https://getpopfile.org/robots.txt
Domain IPs 104.21.50.207, 172.67.167.27, 2606:4700:3032::ac43:a71b, 2606:4700:3037::6815:32cf
Response IP 104.21.50.207
Found Yes
Hash 661e392176e07109bef213ca08118b56ccfc16f684c9cccef2ae870df28b978f
SimHash 5014d821ad52

Groups

*

Rule Path
Disallow /doc/
Disallow /gif/
Disallow /browser/
Disallow /changeset/
Disallow /manual/
Disallow /log/
Disallow /newticket/
Disallow /test/
Disallow /wiki/Trac*
Disallow /wiki/TitleIndex
Disallow /search/

stress-agent

Rule Path
Disallow /

Comments

  • exclude help system from robots
  • disallow the source code browser.
  • no need to index the trac help system
  • and no need to have search results in the search results
  • disallow stress test