lancaster-university.uk
robots.txt

Robots Exclusion Standard data for lancaster-university.uk

Resource Scan

Scan Details

Site Domain lancaster-university.uk
Base Domain lancaster-university.uk
Scan Status Ok
Last Scan2025-09-12T03:01:06+00:00
Next Scan 2025-09-26T03:01:06+00:00

Last Scan

Scanned2025-09-12T03:01:06+00:00
URL https://lancaster-university.uk/robots.txt
Redirect https://www.lancaster.ac.uk/robots.txt
Redirect Domain www.lancaster.ac.uk
Redirect Base lancaster.ac.uk
Domain IPs 148.88.65.80, 2001:630:80:2ff::80:1
Redirect IPs 148.88.65.80, 2001:630:80:2ff::80:1
Response IP 148.88.65.80
Found Yes
Hash eaae2e364dcbb520a220e334c9970713b815c4d10b09237e80d31e6c2ead6210
SimHash 88a9c8d86886

Groups

*

Rule Path
Disallow /careers/mentor-knowledge-bank/
Disallow /fas/centres/sci-tech01/
Disallow /sci-tech/docs/
Disallow /sci-tech/downloads/
Disallow /iens/physics01/
Disallow /study/open-days-and-campus-tours/parking-permits/
Allow /depts/purchase/*
Disallow /Templates/*
Disallow /studentservices/*
Disallow /studentlife/*
Disallow /depts/*
Allow /staff/marsdena/*
Allow /staff/taylorcj/*
Allow /staff/taylorb1/*
Allow /staff/barlowj2/*
Disallow /ug/*
Disallow /sfx/az?*
Disallow /aboutLU/admin.htm
Disallow /celt/sldc/?openpage%20
Disallow /celtweb/OAI/OAI-collaborative-institutions
Disallow /celt/users/international/exchprog.htm
Disallow /celt/users/international/overseas.htm
Disallow /excess/*
Disallow /fass/apsocsci/projects/current/interests
Disallow /fass/centres/cemore/media/*
Disallow /fass/centres/cemore/profiles/*
Disallow /sharman/english/postgrad/creativewriting/*
Disallow /pure
Disallow /sbs/staff/*
Disallow /sbs/student/*
Allow /sbs/accommodation/
Disallow /sbs/accommodation/*
Disallow /current-staff/50th-anniversary/
Disallow /iss/governance/strategy/UniversityICTStrategy2011-14.pdf
Disallow /iss/itpi/digital-tours-/
Disallow /itpi/digitaltour/
Disallow /users/gap/GAP2009/strategic-plan.pdf
Disallow /living-off-campus/
Disallow /library/to-delete/*
Disallow /lums/accounting-and-finance/people/*
Disallow /lums/cphr/people/*
Disallow /lums/dmll/people/*
Disallow /lums/economics/people/*
Disallow /lums/ieed/people/*
Disallow /lums/lancaster-leadership-centre/people/*
Disallow /lums/management-science/people/*
Disallow /lums/marketing/people/*
Disallow /lums/owt/people/*
Disallow /lums/strategy/people/*
Disallow /lums/study/phd/current-phd-students/*
Disallow /lums/accreditation/
Disallow /online-open-day/*
Disallow /people-profiles/*
Disallow /study/undergraduate/subjects/
Disallow /accessibility/

Other Records

Field Value
crawl-delay 5

siteimprovebot

Rule Path
Allow /accessibility/