manchester.ac.uk
robots.txt
Robots Exclusion Standard data for manchester.ac.uk
Resource Scan
Scan Details
Site Domain | manchester.ac.uk |
Base Domain | manchester.ac.uk |
Scan Status | Ok |
Last Scan | 2024-10-30T21:12:58+00:00 |
Next Scan | 2024-11-29T21:12:58+00:00 |
Last Scan
Scanned | 2024-10-30T21:12:58+00:00 |
URL | https://manchester.ac.uk/robots.txt |
Redirect | https://www.manchester.ac.uk/robots.txt |
Redirect Domain | www.manchester.ac.uk |
Redirect Base | manchester.ac.uk |
Domain IPs | 18.133.51.167 |
Redirect IPs | 2600:9000:2721:1800:d:3721:c0c0:93a1, 2600:9000:2721:7800:d:3721:c0c0:93a1, 2600:9000:2721:7c00:d:3721:c0c0:93a1, 2600:9000:2721:800:d:3721:c0c0:93a1, 2600:9000:2721:8c00:d:3721:c0c0:93a1, 2600:9000:2721:b000:d:3721:c0c0:93a1, 2600:9000:2721:c00:d:3721:c0c0:93a1, 2600:9000:2721:d200:d:3721:c0c0:93a1, 3.165.102.115, 3.165.102.19, 3.165.102.35, 3.165.102.69 |
Response IP | 3.165.102.115 |
Found | Yes |
Hash | 94b34aa307c3952930ce292c585643f7f2a20727ea005ee5fee6488ffa0d784e |
SimHash | 19109542c531 |
Groups
*
Rule | Path |
---|---|
Disallow | /_contentlibrary/ |
Disallow | /medialibrary/ |
Allow | /medialibrary/assets/ |
Disallow | /search/ |
Disallow | /AllianceReport2020 |
Disallow | /studentsupportreport2020 |
Disallow | /study/humanities-campaigns/ |
Disallow | /study/masters/humanities-campaigns/ |
Disallow | /study/undergraduate/fse-campaigns/ |
Disallow | /study/undergraduate/humanities-campaigns/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.manchester.ac.uk/sitemap-index.xml |