abertay.ac.uk
robots.txt

Robots Exclusion Standard data for abertay.ac.uk

Resource Scan

Scan Details

Site Domain abertay.ac.uk
Base Domain abertay.ac.uk
Scan Status Ok
Last Scan2024-06-07T20:16:28+00:00
Next Scan 2024-07-07T20:16:28+00:00

Last Scan

Scanned2024-06-07T20:16:28+00:00
URL https://abertay.ac.uk/robots.txt
Redirect https://www.abertay.ac.uk/robots.txt
Redirect Domain www.abertay.ac.uk
Redirect Base abertay.ac.uk
Domain IPs 20.108.144.58
Redirect IPs 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c
Response IP 152.199.39.108
Found Yes
Hash 491f58afd3d611fb3497eb88a27879e435c37442928af70bdbc55b5b36d1e03e
SimHash f10a5840cf14

Groups

funnelback

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /usercontrols/
Disallow /xslt/