bus.umich.edu
robots.txt
Robots Exclusion Standard data for bus.umich.edu
Resource Scan
Scan Details
Site Domain | bus.umich.edu |
Base Domain | umich.edu |
Scan Status | Ok |
Last Scan | 2024-05-08T20:01:21+00:00 |
Next Scan | 2024-06-07T20:01:21+00:00 |
Last Scan
Scanned | 2024-05-08T20:01:21+00:00 |
URL | https://bus.umich.edu/robots.txt |
Redirect | https://www.bus.umich.edu/robots.txt |
Redirect Domain | www.bus.umich.edu |
Redirect Base | umich.edu |
Domain IPs | 141.211.79.140 |
Redirect IPs | 141.211.79.140 |
Response IP | 141.211.79.140 |
Found | Yes |
Hash | bc6c7e0e25609ad364136c74a8190c4ebb3b68e402c4c97e1c2e634be609ec7b |
SimHash | b90178444550 |
Groups
*
Rule | Path |
---|---|
Disallow | /StudentLife/RossRendezvous |
Disallow | /Positive/Ecommerce/PDF |
Disallow | /ConferenceFiles |
Disallow | /StudentCareerServices/ |
Warnings
- `noindex` is not a known field.