library.nd.edu
robots.txt
Robots Exclusion Standard data for library.nd.edu
Resource Scan
Scan Details
| Site Domain | library.nd.edu |
| Base Domain | nd.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-28T14:30:23+00:00 |
| Next Scan | 2024-06-27T14:30:23+00:00 |
Last Scan
| Scanned | 2024-05-28T14:30:23+00:00 |
| URL | https://library.nd.edu/robots.txt |
| Redirect | https://www.library.nd.edu/robots.txt |
| Redirect Domain | www.library.nd.edu |
| Redirect Base | nd.edu |
| Domain IPs | 44.194.89.132, 44.205.125.18 |
| Redirect IPs | 18.155.192.102, 18.155.192.11, 18.155.192.40, 18.155.192.94, 2600:9000:24bb:1000:c:f1f:a140:93a1, 2600:9000:24bb:1400:c:f1f:a140:93a1, 2600:9000:24bb:2000:c:f1f:a140:93a1, 2600:9000:24bb:3c00:c:f1f:a140:93a1, 2600:9000:24bb:6000:c:f1f:a140:93a1, 2600:9000:24bb:8200:c:f1f:a140:93a1, 2600:9000:24bb:9a00:c:f1f:a140:93a1, 2600:9000:24bb:f800:c:f1f:a140:93a1 |
| Response IP | 108.157.52.99 |
| Found | Yes |
| Hash | 04108dd35464cbd5e6b91579583833fc3bb8b9fdaa2c42fc7d8a5c9079a8f115 |
| SimHash | d2146f4cafb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /site-info |
| Disallow | /icons/fdlp-emblem-color.png |
| Disallow | /utilities/search |
| Disallow | /floor/search |
| Disallow | /search?* |
| Disallow | /resource-technical-problem |
| Disallow | /resource-unavailable |
| Disallow | /rbsc |
| Disallow | /archives |