abertay.ac.uk
robots.txt
Robots Exclusion Standard data for abertay.ac.uk
Resource Scan
Scan Details
Site Domain | abertay.ac.uk |
Base Domain | abertay.ac.uk |
Scan Status | Ok |
Last Scan | 2024-06-07T20:16:28+00:00 |
Next Scan | 2024-07-07T20:16:28+00:00 |
Last Scan
Scanned | 2024-06-07T20:16:28+00:00 |
URL | https://abertay.ac.uk/robots.txt |
Redirect | https://www.abertay.ac.uk/robots.txt |
Redirect Domain | www.abertay.ac.uk |
Redirect Base | abertay.ac.uk |
Domain IPs | 20.108.144.58 |
Redirect IPs | 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c |
Response IP | 152.199.39.108 |
Found | Yes |
Hash | 491f58afd3d611fb3497eb88a27879e435c37442928af70bdbc55b5b36d1e03e |
SimHash | f10a5840cf14 |
Groups
*
Rule | Path |
---|---|
Disallow | /aspnet_client/ |
Disallow | /bin/ |
Disallow | /config/ |
Disallow | /data/ |
Disallow | /install/ |
Disallow | /masterpages/ |
Disallow | /python/ |
Disallow | /umbraco/ |
Disallow | /umbraco_client/ |
Disallow | /usercontrols/ |
Disallow | /xslt/ |