research.manchester.ac.uk
robots.txt

Robots Exclusion Standard data for research.manchester.ac.uk

Resource Scan

Scan Details

Site Domain research.manchester.ac.uk
Base Domain manchester.ac.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-18T14:48:57+00:00
Next Scan 2025-05-17T14:48:57+00:00

Last Successful Scan

Scanned2024-12-26T14:47:32+00:00
URL https://research.manchester.ac.uk/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 172.64.148.16
Found Yes
Hash d2f6d6f0d1abc014f9760ca01fd5dd3921f60cdebc6a9f41181ea510968e1e4c
SimHash 6b3d9830a173

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://research.manchester.ac.uk/sitemap.xml