fromoldbooks.org
robots.txt
Robots Exclusion Standard data for fromoldbooks.org
Resource Scan
Scan Details
| Site Domain | fromoldbooks.org |
| Base Domain | fromoldbooks.org |
| Scan Status | Ok |
| Last Scan | 2024-09-26T01:41:55+00:00 |
| Next Scan | 2024-10-03T01:41:55+00:00 |
Last Scan
| Scanned | 2024-09-26T01:41:55+00:00 |
| URL | https://fromoldbooks.org/robots.txt |
| Redirect | https://www.fromoldbooks.org/robots.txt |
| Redirect Domain | www.fromoldbooks.org |
| Redirect Base | fromoldbooks.org |
| Domain IPs | 144.217.66.85 |
| Redirect IPs | 144.217.66.85 |
| Response IP | 144.217.66.85 |
| Found | Yes |
| Hash | ca66b109487a6f4c73776b8bfe4bf7a396245d69848bbe7495bd8b5fc4d35c87 |
| SimHash | 8b015ea6a113 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /~liam |
| Disallow | /Wallpaperify |
| Disallow | /gallerytest |
| Disallow | /Search/castles.cgi |
| Disallow | /Comment |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fromoldbooks.org/www.fromoldbooks.org.xml |