whichuniversitys.co.uk
robots.txt

Robots Exclusion Standard data for whichuniversitys.co.uk

Resource Scan

Scan Details

Site Domain whichuniversitys.co.uk
Base Domain whichuniversitys.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-23T15:49:06+00:00
Next Scan 2025-11-24T15:49:06+00:00

Last Successful Scan

Scanned2025-10-28T02:11:56+00:00
URL https://whichuniversitys.co.uk/robots.txt
Redirect https://www.whichuniversitys.co.uk/robots.txt
Redirect Domain www.whichuniversitys.co.uk
Redirect Base whichuniversitys.co.uk
Domain IPs 104.21.20.100, 172.67.192.18, 2606:4700:3034::ac43:c012, 2606:4700:3035::6815:1464
Redirect IPs 104.21.20.100, 172.67.192.18, 2606:4700:3034::ac43:c012, 2606:4700:3035::6815:1464
Response IP 104.21.20.100
Found Yes
Hash 2e391e637c8f457849af18f6b1afbdbb0363aee49d394cebecdba457860f8c91
SimHash 6008c8008b92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.whichuniversitys.co.uk/sitemap_index.xml
sitemap https://www.whichuniversitys.co.uk/sitemap.xml