inference.org.uk
robots.txt

Robots Exclusion Standard data for inference.org.uk

Resource Scan

Scan Details

Site Domain inference.org.uk
Base Domain inference.org.uk
Scan Status Ok
Last Scan2026-01-21T23:50:44+00:00
Next Scan 2026-02-20T23:50:44+00:00

Last Scan

Scanned2026-01-21T23:50:44+00:00
URL https://inference.org.uk/robots.txt
Domain IPs 2a00:1098:0:86:1000::11, 93.93.131.30
Response IP 93.93.131.30
Found Yes
Hash a82cfaaac868aa5761c271e5009e949de11632d4a32e0b57533fa1cc36f16dfe
SimHash 4c10c20055b2

Groups

*

Rule Path
Disallow /wwwwais/
Disallow /stats/
Disallow /coll-stats/
Disallow /wol-stats/
Disallow /mackay/codes/EN/
Disallow /djw30/dasher/files/
Disallow /dasher/download/training/
Disallow /dasher/download/english/
Disallow /dasher/download/win_9x/
Disallow /dasher/download/win_nt/
Disallow /dasher/download/solaris/
Disallow /stats.html
Disallow /cgi-bin/
Disallow /dasher/download/portuguese/
Disallow /dasher/download/dutch/
Disallow /iaj21/Docs/
Disallow /mackay/secret/

Comments

  • robots.txt for http://www.inference.phy.cam.ac.uk
  • welcome, come on in!
  • reason for disallowing stats: we don't want search engines
  • to discover URLS which aren't linked to anywhere but people have
  • nonetheless accessed (e.g. http://coll.ra.phy.cam.ac.uk URLS)