Log In Sign Up

reading.ac.uk
robots.txt

Robots Exclusion Standard data for reading.ac.uk

Resource Scan

Scan Details

Site Domain reading.ac.uk
Base Domain reading.ac.uk
Scan Status Ok
Last Scan2025-07-18T22:35:06+00:00
Next Scan 2025-08-17T22:35:06+00:00

Last Scan

Scanned2025-07-18T22:35:06+00:00
URL https://reading.ac.uk/robots.txt
Redirect https://www.reading.ac.uk/robots.txt
Redirect Domain www.reading.ac.uk
Redirect Base reading.ac.uk
Domain IPs 134.225.0.151, 2001:630:53:101::97
Redirect IPs 134.225.0.151, 2001:630:53:101::97
Response IP 134.225.0.151
Found Yes
Hash 7f58eb384987ba6d60cb964081aa1703a374a87d477daf8271fc06b98e648ddc
SimHash bb4e5a254760

Groups

*

Rule Path
Disallow /_borders
Disallow /_derived
Disallow /_fpclass
Disallow /_overlay
Disallow /_private
Disallow /_themes
Disallow /_vti_bin
Disallow /_vti_cnf
Disallow /_vti_log
Disallow /_vti_map
Disallow /_vti_pvt
Disallow /_vti_txt
Disallow /UnivRead/vr/dotl/bb_publish/
Disallow /AcaDepts/lk/
Disallow /AcaDepts/lh/
Disallow /AcaDepts/le/
Disallow /AcaDepts/cl/
Disallow /AcaDepts/kl/
Disallow /AcaDepts/lg/
Disallow /AcaDepts/lf/
Disallow /research/media/res-markgasson-19537.asp
Disallow /slas/
Disallow /search/search-departmental-staff.aspx?id=1185
Disallow /search/search-staff.aspx
Back to top

Other Records

Field Value
sitemap https://www.reading.ac.uk/agri-food-economics-marketing/sitemap.xml
sitemap https://www.reading.ac.uk/apd/sitemap.xml
sitemap https://www.reading.ac.uk/animal-sciences/sitemap.xml
sitemap https://www.reading.ac.uk/art/sitemap.xml
sitemap https://www.reading.ac.uk/archaeology/sitemap.xml
sitemap https://www.reading.ac.uk/architecture/sitemap.xml
sitemap https://www.reading.ac.uk/biomedical-engineering/sitemap.xml
sitemap https://www.reading.ac.uk/biological-sciences/sitemap.xml
sitemap https://www.reading.ac.uk/chemistry/sitemap.xml
sitemap https://www.reading.ac.uk/classics/sitemap.xml
sitemap https://www.reading.ac.uk/cme/sitemap.xml
sitemap https://www.reading.ac.uk/computer-science/sitemap.xml
sitemap https://www.reading.ac.uk/crbt/sitemap.xml
sitemap https://www.reading.ac.uk/crop-science/sitemap.xml
sitemap https://www.reading.ac.uk/doctoral-researcher-college/sitemap.xml
sitemap https://www.reading.ac.uk/ecology/sitemap.xml
sitemap https://www.reading.ac.uk/economics/sitemap.xml
sitemap https://www.reading.ac.uk/education/sitemap.xml
sitemap https://www.reading.ac.uk/english-literature/sitemap.xml
sitemap https://www.reading.ac.uk/elal/sitemap.xml
sitemap https://www.reading.ac.uk/film-theatre-television/sitemap.xml
sitemap https://www.reading.ac.uk/food/sitemap.xml
sitemap https://www.reading.ac.uk/ges/sitemap.xml
sitemap https://www.reading.ac.uk/history/sitemap.xml
sitemap https://www.reading.ac.uk/international-development/sitemap.xml
sitemap https://www.reading.ac.uk/isli/sitemap.xml
sitemap https://www.reading.ac.uk/iwlp/sitemap.xml
sitemap https://www.reading.ac.uk/languages-cultures/sitemap.xml
sitemap https://www.reading.ac.uk/law/sitemap.xml
sitemap https://www.reading.ac.uk/maths-and-stats/sitemap.xml
sitemap https://www.reading.ac.uk/meteorology/sitemap.xml
sitemap https://www.reading.ac.uk/pcls/sitemap.xml
sitemap https://www.reading.ac.uk/pharmacy/sitemap.xml
sitemap https://www.reading.ac.uk/philosophy/sitemap.xml
sitemap https://www.reading.ac.uk/politics-international-relations/sitemap.xml
sitemap https://www.reading.ac.uk/typography/sitemap.xml
sitemap https://www.reading.ac.uk/sustainable-land-management/sitemap.xml
sitemap https://www.reading.ac.uk/acd/sitemap.xml
sitemap https://www.reading.ac.uk/biological-sciences/sitemap.xml
sitemap https://www.reading.ac.uk/humanities/sitemap.xml
sitemap https://www.reading.ac.uk/literature-languages/sitemap.xml
sitemap https://www.reading.ac.uk/sages/sitemap.xml
sitemap https://www.reading.ac.uk/sbe/sitemap.xml
sitemap https://www.reading.ac.uk/scfp/sitemap.xml
sitemap https://www.reading.ac.uk/smpcs/sitemap.xml
sitemap https://www.reading.ac.uk/speir/sitemap.xml
sitemap https://www.reading.ac.uk/academic-governance-services/sitemap.xml
sitemap https://www.reading.ac.uk/admissions/sitemap.xml
sitemap https://www.reading.ac.uk/ame/sitemap.xml
sitemap https://www.reading.ac.uk/atoz/sitemap.xml
sitemap https://www.reading.ac.uk/blackbox/sitemap.xml
sitemap https://www.reading.ac.uk/business-continuity/sitemap.xml
sitemap https://www.reading.ac.uk/campus-card/sitemap.xml
sitemap https://www.reading.ac.uk/cetl-aurs/sitemap.xml
sitemap https://www.reading.ac.uk/chaplaincy/sitemap.xml
sitemap https://www.reading.ac.uk/charter-reform/sitemap.xml
sitemap https://www.reading.ac.uk/cps/sitemap.xml
sitemap https://www.reading.ac.uk/cqsd/sitemap.xml
sitemap https://www.reading.ac.uk/digital-technology-services/sitemap.xml
sitemap https://www.reading.ac.uk/disability/sitemap.xml
sitemap https://www.reading.ac.uk/diversity/sitemap.xml
sitemap https://www.reading.ac.uk/escop/sitemap.xml
sitemap https://www.reading.ac.uk/estates/sitemap.xml
sitemap https://www.reading.ac.uk/exams/sitemap.xml
sitemap https://www.reading.ac.uk/finance/sitemap.xml
sitemap https://www.reading.ac.uk/health-innovation-partnership/sitemap.xml
sitemap https://www.reading.ac.uk/health-safety-services/sitemap.xml
sitemap https://www.reading.ac.uk/human-resources/sitemap.xml
sitemap https://www.reading.ac.uk/imps/sitemap.xml
sitemap https://www.reading.ac.uk/internal-audit/sitemap.xml
sitemap https://www.reading.ac.uk/inform/sitemap.xml
sitemap https://www.reading.ac.uk/ktc/sitemap.xml
sitemap https://www.reading.ac.uk/legal-services/sitemap.xml
sitemap https://www.reading.ac.uk/library/sitemap.xml
sitemap https://www.reading.ac.uk/lrc/sitemap.xml
sitemap https://www.reading.ac.uk/parent-family-network/sitemap.xml
sitemap https://www.reading.ac.uk/planning/sitemap.xml
sitemap https://www.reading.ac.uk/procurement/sitemap.xml
sitemap https://www.reading.ac.uk/research-services/sitemap.xml
sitemap https://www.reading.ac.uk/risis/sitemap.xml
sitemap https://www.reading.ac.uk/global-study-lounge/sitemap.xml
sitemap https://www.reading.ac.uk/staff-common-room/sitemap.xml
sitemap https://www.reading.ac.uk/technical-services/sitemap.xml
sitemap https://www.reading.ac.uk/essentials/essentials_sitemap
sitemap https://www.reading.ac.uk/planet/sitemap.xml
sitemap https://www.reading.ac.uk/shinfield-community/sitemap.xml
sitemap https://www.reading.ac.uk/business-management/sitemap.xml
sitemap https://www.reading.ac.uk/lgbtq-plus-history-month/sitemap.xml
sitemap https://www.reading.ac.uk/afit/sitemap.xml
sitemap https://www.reading.ac.uk/asset/sitemap.xml
sitemap https://www.reading.ac.uk/caf/sitemap.xml
sitemap https://www.reading.ac.uk/cluster-for-hellenic-studies/sitemap.xml
sitemap https://www.reading.ac.uk/east-german-studies-archive/sitemap.xml
sitemap https://www.reading.ac.uk/fiscal-history/sitemap.xml
sitemap https://www.reading.ac.uk/food-processing-centre/sitemap.xml
sitemap https://www.reading.ac.uk/gcms/sitemap.xml
sitemap https://www.reading.ac.uk/herbarium/sitemap.xml
sitemap https://www.reading.ac.uk/hsuhn/sitemap.xml
sitemap https://www.reading.ac.uk/infrared/sitemap.xml
sitemap https://www.reading.ac.uk/languages-at-war/sitemap.xml
sitemap https://www.reading.ac.uk/language-text-power/sitemap.xml
sitemap https://www.reading.ac.uk/ltrk/sitemap.xml
sitemap https://www.reading.ac.uk/people-and-wildlife/sitemap.xml
sitemap https://www.reading.ac.uk/quest/sitemap.xml
sitemap https://www.reading.ac.uk/rsbn/sitemap.xml
sitemap https://www.reading.ac.uk/soil-research-centre/sitemap.xml
sitemap https://www.reading.ac.uk/urop/sitemap.xml
sitemap https://www.reading.ac.uk/brand/sitemap.xml
sitemap https://www.reading.ac.uk/womens-history-month/sitemap.xml
Back to top

Comments

  • Ignore FrontPage files
  • Dissallow list
  • see ticket 305095 regarding exclusions below
  • url below for attention of media agencies only
  • see ticket 428842
  • see ticket I-1411-5089
  • I-1608-1790
  • S&D
  • Schools
  • Function
  • StudentJourney
  • Campaign
  • Research
Back to top

Warnings

  • 2 invalid lines.
Back to top