research-portal.uea.ac.uk
robots.txt

Robots Exclusion Standard data for research-portal.uea.ac.uk

Resource Scan

Scan Details

Site Domain research-portal.uea.ac.uk
Base Domain uea.ac.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-25T14:39:08+00:00
Next Scan 2025-05-24T14:39:08+00:00

Last Successful Scan

Scanned2025-01-02T14:24:39+00:00
URL https://research-portal.uea.ac.uk/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 104.18.39.240
Found Yes
Hash 12f1679c6b3ad697a0c6c3bcffc0510306756738b2d572f4d86ffa3bbbca2612
SimHash 6b3dd860a373

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://research-portal.uea.ac.uk/sitemap.xml