gcc.mass.edu
robots.txt
Robots Exclusion Standard data for gcc.mass.edu
Resource Scan
Scan Details
Site Domain | gcc.mass.edu |
Base Domain | mass.edu |
Scan Status | Ok |
Last Scan | 2025-08-24T02:50:48+00:00 |
Next Scan | 2025-09-23T02:50:48+00:00 |
Last Scan
Scanned | 2025-08-24T02:50:48+00:00 |
URL | https://gcc.mass.edu/robots.txt |
Domain IPs | 162.159.134.42 |
Response IP | 162.159.134.42 |
Found | Yes |
Hash | b4e56ab7260d7c9d87bb06cdffbaf7dfcbf43f24245ce1af096da5c01de668c2 |
SimHash | 454f7a624926 |
Groups
*
Rule | Path |
---|---|
Disallow | /library/journal-locator/* |
Disallow | /library/people/* |
Disallow | /tutoring/student/* |
Disallow | /tutoring/note* |
Disallow | /mentorships/mentors* |
Disallow | /gainful-employment/ |
Disallow | *feed-items |
Disallow | /50/ |
Disallow | /academic/catalog* |
Disallow | /academic-affairs/office/ |
Disallow | /academics/?attachment* |
Disallow | /academics/course-sequences/ |
Disallow | /academics/degree/ |
Disallow | /admissions/events/ |
Disallow | /admissions/faqs/ |
Disallow | /admissions/transfer-credit* |
Disallow | /advising/issues* |
Disallow | /author/ |
Disallow | /cashbox |
Disallow | /catalystold/ |
Disallow | */categories/* |
Disallow | /directories/* |
Disallow | /dolgrant/ |
Disallow | *drafts |
Disallow | /ems/faqs* |
Disallow | *faq-category |
Disallow | /faculty-support/ |
Disallow | /families/ |
Disallow | *files |
Disallow | /ge/ |
Disallow | /hr/ix* |
Disallow | /hr/policy* |
Disallow | /information-security/ |
Disallow | /it/calendar/ |
Disallow | /it/events/ |
Disallow | /learning-resources/ |
Disallow | /liberal-arts/ |
Disallow | /library/device/ |
Disallow | /local-control/ |
Disallow | /locations/ |
Disallow | /massage/ |
Disallow | */mc-events/ |
Disallow | /media/ |
Disallow | /mentorships/mentor* |
Disallow | /newfoundation/ |
Disallow | /news/feed/ |
Disallow | */notice/ |
Disallow | /online-orientation/ |
Disallow | /newdei/ |
Disallow | /non-credit/slide/ |
Disallow | */person/* |
Disallow | /playground/ |
Disallow | /plum/author* |
Disallow | /?post_type=tabs* |
Disallow | /professional-development/ |
Disallow | *qa_faqs |
Disallow | /semp/ |
Disallow | /student-affairs/handbooks/ |
Disallow | /students/handbooks/ |
Disallow | *tabs |
Disallow | */tag/* |
Disallow | /testweb/ |
Disallow | /transfer/major/* |
Disallow | /transfer/program/* |
Disallow | /transfer/school/ |
Disallow | /webdocs/* |
Disallow | /wellness/resource/* |
Disallow | /workforce-development/ |
Disallow | /development/ |
Disallow | */ufaq/* |
Disallow | /?presenter |
Disallow | *? |
Disallow | /*?* |