qmul.ac.uk
robots.txt
Robots Exclusion Standard data for qmul.ac.uk
Resource Scan
Scan Details
| Site Domain | qmul.ac.uk |
| Base Domain | qmul.ac.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-02T20:45:23+00:00 |
| Next Scan | 2025-12-16T20:45:23+00:00 |
Last Successful Scan
| Scanned | 2025-10-24T20:03:13+00:00 |
| URL | https://qmul.ac.uk/robots.txt |
| Redirect | https://www.qmul.ac.uk/robots.txt |
| Redirect Domain | www.qmul.ac.uk |
| Redirect Base | qmul.ac.uk |
| Domain IPs | 13.248.251.159, 3.33.156.208 |
| Redirect IPs | 2600:9000:271a:1200:1b:d131:b340:93a1, 2600:9000:271a:3a00:1b:d131:b340:93a1, 2600:9000:271a:6600:1b:d131:b340:93a1, 2600:9000:271a:7200:1b:d131:b340:93a1, 2600:9000:271a:8200:1b:d131:b340:93a1, 2600:9000:271a:8800:1b:d131:b340:93a1, 2600:9000:271a:8a00:1b:d131:b340:93a1, 2600:9000:271a:b200:1b:d131:b340:93a1, 3.165.75.109, 3.165.75.119, 3.165.75.17, 3.165.75.2 |
| Response IP | 3.165.75.17 |
| Found | Yes |
| Hash | c5a52ad090e33c81f8854a22e554b7265f110f337780339dde4557bac72c3ebc |
| SimHash | 1c199121ef90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /test/ |
| Disallow | /master-course-assets/ |
| Disallow | /jobs/uat/ |
| Disallow | /undergraduate/coursefinder/courses/2023/ |
| Disallow | /undergraduate/coursefinder/courses/2024/ |
| Disallow | /undergraduate/coursefinder/courses/2025/ |
| Disallow | /ceg/data-resources/ceg-dashboards/ceg-dashboards-hub/ |
| Disallow | /blizard/ceg/dashboards/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.qmul.ac.uk/sitemap.xml |
Comments