liverpool.ac.uk
robots.txt
Robots Exclusion Standard data for liverpool.ac.uk
Resource Scan
Scan Details
| Site Domain | liverpool.ac.uk |
| Base Domain | liverpool.ac.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-28T22:16:51+00:00 |
| Next Scan | 2024-11-27T22:16:51+00:00 |
Last Scan
| Scanned | 2024-10-28T22:16:51+00:00 |
| URL | https://liverpool.ac.uk/robots.txt |
| Redirect | https://www.liverpool.ac.uk/robots.txt |
| Redirect Domain | www.liverpool.ac.uk |
| Redirect Base | liverpool.ac.uk |
| Domain IPs | 138.253.13.50 |
| Redirect IPs | 138.253.13.50 |
| Response IP | 138.253.13.50 |
| Found | Yes |
| Hash | c51a619e9c2df2b33d633b333e40240a9fa70c07bbcea1a382b031a10df6fe27 |
| SimHash | 014810d36431 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/tulip-template/ |
| Disallow | /intranet/ |
| Disallow | /Intranet/ |
| Disallow | /search/ |
| Disallow | /courses/search? |
| Disallow | /psychology-health-and-society/research/reactions-to-cancer/ |
| Disallow | /staff-profile-preview/ |
| Disallow | /staff-profile-processing/ |
| Disallow | /clearing/template/ |
| Disallow | /redbrick/ |
Comments