humanities.org
robots.txt

Robots Exclusion Standard data for humanities.org

Resource Scan

Scan Details

Site Domain humanities.org
Base Domain humanities.org
Scan Status Ok
Last Scan2025-09-22T06:40:55+00:00
Next Scan 2025-10-22T06:40:55+00:00

Last Scan

Scanned2025-09-22T06:40:55+00:00
URL https://humanities.org/robots.txt
Domain IPs 104.21.86.217, 172.67.137.60, 2606:4700:3033::6815:56d9, 2606:4700:3033::ac43:893c
Response IP 172.67.137.60
Found Yes
Hash f254cd2e67fec8f48bf4ea585bedfc77806fe6586a8b7483fa682f65bd4922ef
SimHash b9104c0e8673

Groups

spbot

Rule Path
Disallow /

slurp<br> crawl-delay: 100

No rules defined. All paths allowed.