purl.archive.org
robots.txt

Robots Exclusion Standard data for purl.archive.org

Resource Scan

Scan Details

Site Domain purl.archive.org
Base Domain archive.org
Scan Status Ok
Last Scan2025-06-20T21:05:48+00:00
Next Scan 2025-07-20T21:05:48+00:00

Last Scan

Scanned2025-06-20T21:05:48+00:00
URL https://purl.archive.org/robots.txt
Domain IPs 207.241.225.157
Response IP 207.241.225.157
Found Yes
Hash d786d8154232e0d3804e0ffeef601df928cdd0ef5bfe5fa8df4975af6ed9c0b7
SimHash 6510d452e735

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1