alumni.ids.ac.uk
robots.txt

Robots Exclusion Standard data for alumni.ids.ac.uk

Resource Scan

Scan Details

Site Domain alumni.ids.ac.uk
Base Domain ids.ac.uk
Scan Status Ok
Last Scan2025-12-21T19:06:50+00:00
Next Scan 2026-01-20T19:06:50+00:00

Last Scan

Scanned2025-12-21T19:06:50+00:00
URL https://alumni.ids.ac.uk/robots.txt
Domain IPs 54.229.188.217
Response IP 54.229.188.217
Found Yes
Hash fa0d2f355b28c6d6e762e9cf0f641a6e80758b677c1ffccefa94b3ca289c5e6f
SimHash 2c419a08c453

Groups

mj12bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

my-tiny-bot

Rule Path
Disallow /

*

Rule Path
Disallow /uploads/default/
Disallow /register
Disallow /event/registration/success/
Disallow /event/registration/paypal/success/
Disallow /event/registration/paypal/cancelled/
Disallow /event/registration/stripe/success/
Disallow /event/registration/stripe/cancelled/
Disallow /event/registration/offline/
Disallow /surveys/success/
Disallow /files/download/
Disallow /admin-portal/email-engine/unsubscribe/
Disallow /admin-portal/email-engine/unsubscribe/
Disallow /flat/unsubscribe-confirmation-ask/
Disallow /unsubscribed/
Disallow /webview/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://alumni.ids.ac.uk/sitemap.xml