gcc.mass.edu
robots.txt

Robots Exclusion Standard data for gcc.mass.edu

Resource Scan

Scan Details

Site Domain gcc.mass.edu
Base Domain mass.edu
Scan Status Ok
Last Scan2025-08-24T02:50:48+00:00
Next Scan 2025-09-23T02:50:48+00:00

Last Scan

Scanned2025-08-24T02:50:48+00:00
URL https://gcc.mass.edu/robots.txt
Domain IPs 162.159.134.42
Response IP 162.159.134.42
Found Yes
Hash b4e56ab7260d7c9d87bb06cdffbaf7dfcbf43f24245ce1af096da5c01de668c2
SimHash 454f7a624926

Groups

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /library/journal-locator/*
Disallow /library/people/*
Disallow /tutoring/student/*
Disallow /tutoring/note*
Disallow /mentorships/mentors*
Disallow /gainful-employment/
Disallow *feed-items
Disallow /50/
Disallow /academic/catalog*
Disallow /academic-affairs/office/
Disallow /academics/?attachment*
Disallow /academics/course-sequences/
Disallow /academics/degree/
Disallow /admissions/events/
Disallow /admissions/faqs/
Disallow /admissions/transfer-credit*
Disallow /advising/issues*
Disallow /author/
Disallow /cashbox
Disallow /catalystold/
Disallow */categories/*
Disallow /directories/*
Disallow /dolgrant/
Disallow *drafts
Disallow /ems/faqs*
Disallow *faq-category
Disallow /faculty-support/
Disallow /families/
Disallow *files
Disallow /ge/
Disallow /hr/ix*
Disallow /hr/policy*
Disallow /information-security/
Disallow /it/calendar/
Disallow /it/events/
Disallow /learning-resources/
Disallow /liberal-arts/
Disallow /library/device/
Disallow /local-control/
Disallow /locations/
Disallow /massage/
Disallow */mc-events/
Disallow /media/
Disallow /mentorships/mentor*
Disallow /newfoundation/
Disallow /news/feed/
Disallow */notice/
Disallow /online-orientation/
Disallow /newdei/
Disallow /non-credit/slide/
Disallow */person/*
Disallow /playground/
Disallow /plum/author*
Disallow /?post_type=tabs*
Disallow /professional-development/
Disallow *qa_faqs
Disallow /semp/
Disallow /student-affairs/handbooks/
Disallow /students/handbooks/
Disallow *tabs
Disallow */tag/*
Disallow /testweb/
Disallow /transfer/major/*
Disallow /transfer/program/*
Disallow /transfer/school/
Disallow /webdocs/*
Disallow /wellness/resource/*
Disallow /workforce-development/
Disallow /development/
Disallow */ufaq/*
Disallow /?presenter
Disallow *?
Disallow /*?*