aurora.edu
robots.txt

Robots Exclusion Standard data for aurora.edu

Resource Scan

Scan Details

Site Domain aurora.edu
Base Domain aurora.edu
Scan Status Ok
Last Scan2024-11-17T19:11:23+00:00
Next Scan 2024-12-17T19:11:23+00:00

Last Scan

Scanned2024-11-17T19:11:23+00:00
URL https://aurora.edu/robots.txt
Domain IPs 40.141.207.29
Response IP 40.141.207.29
Found Yes
Hash b37cf42861215882edb47e1dad24ebf6d0f0c7db5b0ea20757367cf207cb6402
SimHash 5450b1e464d3

Groups

ninjabot

Rule Path
Allow /

*

Rule Path
Disallow /athletics/
Disallow /wsoccer/
Disallow /tmp/
Disallow /documents/tmp/
Disallow /classes/
Disallow /classrooms/
Disallow /stacy
Disallow /documents/policies/mandated-reporter-policy.docx
Disallow /documents/policies/consensual-relationships-policy.docx
Disallow /documents/policies/dress-code-policy.docx
Disallow /documents/policies/smoke-free-campus-policy.docx
Disallow /documents/policies/alcohol-and-drug-free-workplace-policy.docx
Disallow /documents/policies/whistleblower-policy.docx
Disallow /documents/policies/media-relations-policy.docx
Disallow /documents/policies/cook-county-and-chicago-earned-sick-leave-policy.docx
Disallow /documents/about/strategic-plan-12072020.pdf
Disallow /undergrad-catalog-2016-2017/athletic-training/index.html
Disallow /academics/undergraduate/communication/index.html
Disallow /academics/undergraduate/communication/major-requirements.html
Disallow /digital-signage/
Disallow /notfound.html
Disallow /storytellers/storytellerstest.html
Disallow /storytellers/
Disallow /admission/foo.html
Disallow /board/
Disallow /m.html
Disallow /au/
Disallow /library/ereserve/
Disallow /scoreboard/admin/
Disallow /cohorts/admin/
Disallow /secure/
Disallow /stage/
Disallow /alumni/index-3column.html
Disallow /athletics/tv-slider.html
Disallow /php/
Disallow /calendar/export/export.php
Disallow /academics/graduate/marketing/ad-digital-marketing.html
Disallow /academics/graduate/marketing/ad-analytics.html
Disallow /grad-catalog-2016-2017/
Disallow /grad-catalog-2017-2018/
Disallow /grad-catalog-2018-2019/
Disallow /grad-catalog-2019-2020/
Disallow /undergrad-catalog-2016-2017/
Disallow /undergrad-catalog-2017-2018/
Disallow /undergrad-catalog-2018-2019/
Disallow /undergrad-catalog-2019-2020/
Disallow /academics/continuing-education/
Disallow /undergrad-catalog-2017-2018/athletic-training/
Disallow /undergrad-catalog-2016-2017/athletic-training/
Disallow /grad-catalog-2017-2018/athletic-training/
Disallow /academics/undergraduate/speech-language-pathology/
Disallow /academics/undergraduate/communication/
Disallow /academics/colleges-schools/dhhp/
Disallow /academics/colleges-schools/shape/
Disallow /academics/undergraduate/fitness-health-promotion/
Disallow /catalog/
Disallow /academics/programs-majors/
Disallow /academics/special-programs/honors/
Disallow /academics/programs-majors/undergraduate/film-studies/
Disallow /academics/programs-majors/undergraduate/elementary-ed/
Disallow /academics/special-programs/honors/
Disallow /student-life/career-services/
Disallow /student-life/campus-safety/
Disallow /student-life/wellness/
Disallow /academics/resources/registrar/
Disallow /artsandideas/
Disallow /academics/programs-majors/undergraduate/hospitality-management/
Disallow /publications/
Disallow /education/
Disallow /biology/
Disallow /registrar/
Disallow /library/
Disallow /studentaccounts/
Disallow /recadmin/
Disallow /owls/
Disallow /socialwork/
Disallow /career/
Disallow /ada/
Disallow /mayterm/
Disallow /admission/financialaid/student-accounts/
Disallow /athletics/spartanreport/
Disallow /events/
Disallow /documents/owls/
Disallow /organizations/satso/
Disallow /academics/special-programs/institute/about-institute/
Disallow /academics/special-programs/institute/initiatives/
Disallow /academics/special-programs/institute/results/
Disallow /hr/forms/
Disallow /email-addresses/
Disallow /makeadifference/
Disallow /spartanpride/
Disallow /changelives/
Disallow /uinau/
Disallow /student-life/campus-services/wellness/index.html/*
Disallow /*.html/*

Comments

  • These rules are are to remove old directories from Google's search index
  • This rule is for trapping disobedient robots
  • This rule is for mStoner's project with Advancement

Warnings

  • 1 invalid line.