shib.raven.cam.ac.uk
robots.txt

Robots Exclusion Standard data for shib.raven.cam.ac.uk

Resource Scan

Scan Details

Site Domain shib.raven.cam.ac.uk
Base Domain cam.ac.uk
Scan Status Ok
Last Scan2025-06-01T19:59:19+00:00
Next Scan 2025-07-01T19:59:19+00:00

Last Scan

Scanned2025-06-01T19:59:19+00:00
URL https://shib.raven.cam.ac.uk/robots.txt
Domain IPs 34.117.105.168
Response IP 34.117.105.168
Found Yes
Hash 91ae32087ae09a0b8ded48abc9147789e2899059a5d978ab593705f5c713835e
SimHash cc78811bcf73

Groups

university of cambridge search

Rule Path
Allow /idp/profile/SAML2/Redirect/SSO
Disallow /

*

Rule Path
Disallow /

Comments

  • University search engine can fetch the attribute release page but nothing
  • else. The full user agent is "University of Cambridge search
  • (search-support@uis.cam.ac.uk)" but we remove the email address here to allow
  • the support email address to change in future.
  • All other user agents can fetch nothing.