www.library.illinois.edu
robots.txt
Robots Exclusion Standard data for www.library.illinois.edu
Resource Scan
Scan Details
| Site Domain | www.library.illinois.edu |
| Base Domain | illinois.edu |
| Scan Status | Ok |
| Last Scan | 2024-04-24T03:32:18+00:00 |
| Next Scan | 2024-05-24T03:32:18+00:00 |
Last Scan
| Scanned | 2024-04-24T03:32:18+00:00 |
| URL | https://www.library.illinois.edu/robots.txt |
| Domain IPs | 130.126.162.146 |
| Response IP | 130.126.162.146 |
| Found | Yes |
| Hash | b2663d9f7c52afb27b1c234d5dbaa06d453e99cda422c4d754c642335e1a1dd6 |
| SimHash | ca44db43f383 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bibapp/ |
| Disallow | /ereserves/ |
| Disallow | /mailform/ |
| Disallow | /newtitles/ |
| Disallow | /pilot/ |
| Disallow | /proxy/ |
| Disallow | /rex/rolodex/ |
| Disallow | /gateway/ |
| Disallow | /hpnl/staff/ |
| Disallow | /archives/email-ahx.php |