ibiblio.org
robots.txt
Robots Exclusion Standard data for ibiblio.org
Resource Scan
Scan Details
| Site Domain | ibiblio.org |
| Base Domain | ibiblio.org |
| Scan Status | Ok |
| Last Scan | 2024-09-28T18:19:31+00:00 |
| Next Scan | 2024-10-28T18:19:31+00:00 |
Last Scan
| Scanned | 2024-09-28T18:19:31+00:00 |
| URL | https://ibiblio.org/robots.txt |
| Domain IPs | 152.19.134.40, 2610:28:3090:3000:0:bad:cafe:23 |
| Response IP | 152.19.134.40 |
| Found | Yes |
| Hash | 73da0fc63a33f74b9c1a336b2bbee540c86dcd7539a8116e499823ada826ba6f |
| SimHash | 6c5dd59457e0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dbarberi/wiki/ |
| Disallow | /designerunits/images/ |
| Disallow | /designerunits/image*/ |
| Disallow | /footy/tools/ |
| Disallow | /herbmed/getit.php |
| Disallow | /mcmahon/emusic-l/ |
| Disallow | /ncdarts/bcdl/search/ |
| Disallow | /rtpnet/archives/ |
| Disallow | /schools/fpg/ |
| Disallow | /ser/cvs/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Comments