tartarus.org
robots.txt

Robots Exclusion Standard data for tartarus.org

Resource Scan

Scan Details

Site Domain tartarus.org
Base Domain tartarus.org
Scan Status Ok
Last Scan2026-01-07T01:14:54+00:00
Next Scan 2026-02-06T01:14:54+00:00

Last Scan

Scanned2026-01-07T01:14:54+00:00
URL https://tartarus.org/robots.txt
Domain IPs 5.196.91.86
Response IP 5.196.91.86
Found Yes
Hash 2bc2e0f8b5810bdb1c1e9061711dad8fd97f976132cfabaf0a9c7c5072e10891
SimHash 283ad830c313

Groups

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /