dsource.org
robots.txt

Robots Exclusion Standard data for dsource.org

Resource Scan

Scan Details

Site Domain dsource.org
Base Domain dsource.org
Scan Status Ok
Last Scan2025-06-20T10:54:44+00:00
Next Scan 2025-07-20T10:54:44+00:00

Last Scan

Scanned2025-06-20T10:54:44+00:00
URL https://dsource.org/robots.txt
Domain IPs 104.21.29.187, 172.67.149.157, 2606:4700:3031::ac43:959d, 2606:4700:3037::6815:1dbb
Response IP 172.67.149.157
Found Yes
Hash 82379d370708562e55399489561d0a60f99057473f16143ee58363da0346ad83
SimHash 191c1f81e5c8

Groups

*

Rule Path
Disallow /projects/*/browser
Disallow /projects/*/changeset
Disallow /projects/*/log
Disallow /projects/*/milestone
Disallow /projects/*/search
Disallow /projects/*/timeline
Disallow /projects/*/roadmap
Disallow /projects/*/report
Disallow /projects/*/newticket

Other Records

Field Value
crawl-delay 60

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /