umb.edu
robots.txt

Robots Exclusion Standard data for umb.edu

Resource Scan

Scan Details

Site Domain umb.edu
Base Domain umb.edu
Scan Status Ok
Last Scan2024-09-15T09:34:25+00:00
Next Scan 2024-10-15T09:34:25+00:00

Last Scan

Scanned2024-09-15T09:34:25+00:00
URL https://umb.edu/robots.txt
Redirect https://www.umb.edu/robots.txt
Redirect Domain www.umb.edu
Redirect Base umb.edu
Domain IPs 15.197.216.151
Redirect IPs 108.157.254.127, 108.157.254.27, 108.157.254.46, 108.157.254.96, 2600:9000:2135:200:c:d13c:4d40:93a1, 2600:9000:2135:2800:c:d13c:4d40:93a1, 2600:9000:2135:3400:c:d13c:4d40:93a1, 2600:9000:2135:6400:c:d13c:4d40:93a1, 2600:9000:2135:b000:c:d13c:4d40:93a1, 2600:9000:2135:d400:c:d13c:4d40:93a1, 2600:9000:2135:e000:c:d13c:4d40:93a1, 2600:9000:2135:f600:c:d13c:4d40:93a1
Response IP 108.157.254.27
Found Yes
Hash 341a912633875dcdf741e87acf9000afd18b93db769d2911abd02fd1e654fd84
SimHash ccfbde59c772

Groups

*

Rule Path
Disallow /site-assets/
Disallow /site-assets/common-header/search-bar-google/
Disallow /site-assets/common-footer/footer-scripts---page-up/
Disallow /site-assets/images/
Disallow /site-assets/google-search-scripts/
Disallow /404/
Disallow /mccormack/forms/cameroon/thank-you/
Disallow /news/categories/news/
Disallow /news/feed.rss
Disallow /about/leadership-administration/chancellor-event-request/thank-you/
Disallow /about/leadership-administration/chancellor-meeting-request/thank-you/
Disallow /about/leadership-administration/chancellors-lecture-series/
Disallow /about/leadership-administration/beacon-wellness-initiative/
Disallow /about/leadership-administration/holiday-greetings/
Disallow /about/side-wide-notices/
Disallow /admissions/first-year-students/apply/dual-enrollment-partnership-opportunities/dual-enrollment-interest-form/thank-you/
Disallow /financial-aid/apply-for-financial-aid/forms/scholarship-disbursement-form/thank-you/
Disallow /campus-life/housing-dining/on-campus/housing-payment-information/
Disallow /campus-life/student-affairs/campus-currents-content-submission/thank-you/
Disallow /campus-life/student-affairs/vice-chancellor-for-student-affairs-event-request/thank-you/
Disallow /research/request-broadcast-email/thank-you/
Disallow /research/community-driven-research/global-inclusion-and-social-development/
Disallow /core-facilities/biophysical-instrumentation-core/affinity-itc/
Disallow /core-facilities/biophysical-instrumentation-core/cytiva-biacore-8k/
Disallow /core-facilities/biophysical-instrumentation-core/dynapro-nanostar-2/
Disallow /core-facilities/biophysical-instrumentation-core/jasco-fp-8350/
Disallow /core-facilities/biophysical-instrumentation-core/jasco-j1500/
Disallow /core-facilities/biophysical-instrumentation-core/nanodsc/
Disallow /core-facilities/biophysical-instrumentation-core/nanotemper-monolith/
Disallow /core-facilities/biophysical-instrumentation-core/wyatt-dawn-ambient/
Disallow /academics/seas/disability-services/forms/release-form/thank-you/
Disallow /academics/seas/disability-services/forms/transition-day/thank-you/
Disallow /education/global-inclusion/student-forms/request-graduate-programs-info/thank-you/
Disallow /education/global-inclusion/student-forms/request-certificate-programs-info/thank-you/
Disallow /education/student-success/foundations-of-reading/april-26-2024/thank-you/
Disallow /education/student-success/mathematics/june-5-2024/thank-you/
Disallow /liberal-arts/academic-departments/art/research--impact/news/thinking-about-climate-change/thank-you/
Disallow /liberal-arts/academic-departments/classics-religious-studies/student-resources/
Disallow /nursing-health-sciences/departments-centers/gerontology/study-aging/
Disallow /nursing-health-sciences/scholarships-beacons-of-promise/first-year-scholars/
Disallow /nursing-health-sciences/contact-us/thank-you/
Disallow /science-mathematics/academic-departments/biology/student-resources/tribeta-honor-society-applications/
Disallow /athletics/recreation/facilities-hours/athletics-event-request-for-non-university-clients/thank-you/
Disallow /component-library/
Disallow /component-library/college-of-education--sgisd-feature-panels/
Disallow /component-library/college-of-liberal-arts-feature-panels/
Disallow /component-library/college-of-science--math-feature-panels/
Disallow /component-library/college-of-management-feature-panels/
Disallow /component-library/college-of-nursing--department-feature-panels/
Disallow /component-library/school-for-the-environment-feature-panels/
Disallow /component-library/next-steps-graduate-undergraduate-business/
Disallow /component-library/emma-css/
Disallow /convocation/thank-you/
Disallow /csde/camp-shriver-community/camp-shriver/registration-fee/
Disallow /csde/camp-shriver-staff-information/
Disallow /csde/camp-shriver-family-information/
Disallow /event-services/on-site-services/office-furniture-move-request-form/thank-you/
Disallow /event-services/non-university-clients/campus-center-post-event-evaluation/thank-you/
Disallow /event-services/non-university-clients/event-services-request-for-non-university-clients/thank-you/
Disallow /event-services/reservation-policies/protests-and-demonstrations/thank-you/
Disallow /gaston-institute/contact/join-our-mailing-list/thank-you/
Disallow /here4u/thank-you/
Disallow /community/community-relations/isc-lighting-request/thank-you/
Disallow /community/community-partnerships/fireside-chat/
Disallow /community/community-partnerships/fireside-chat/thank-you/
Disallow /leaders/center-programs/elp-nomination/thank-you/
Disallow /leaders/center-programs/elp-applications/thank-you/
Disallow /leaders/center-programs/team-public-presentations-2024-08-22/thank-you/
Disallow /leaders/center-programs/graduation-rsvp-2024-08-22/thank-you/
Disallow /marineops/forms/thank-you/
Disallow /nantucket/courses/biol-344-345/thank-you/
Disallow /nantucket/courses/hist-276/thank-you/
Disallow /nantucket/courses/biol-306-506/thank-you/
Disallow /nantucket/courses/battle-family-scholarships/thank-you/
Disallow /nantucket/courses/envsci-321/thank-you/
Disallow /nantucket/courses/internship-application/thank-you/
Disallow /nantucket/facilities/nantucket-field-station-reservation-request/thank-you/
Disallow /nantucket/facilities/equipment--lab-use-request-form/thank-you/
Disallow /orientation/orientation-guide/
Disallow /orientation/student-guide/
Disallow /orientation/student-guide/study/
Disallow /orientation/student-guide/connect/
Disallow /orientation/student-guide/live/
Disallow /orientation/student-guide/engage/
Disallow /orientation/student-guide/be-well/
Disallow /orientation/student-guide/visit/
Disallow /ofd/events/ta-tf-training-2023-09-29/
Disallow /ofd/events/ta-tf-training-2024-08-29/
Disallow /ofd/resources/graduate-teaching-program-registration-form/thank-you/
Disallow /pensionaction/request-assistance/thank-you/
Disallow /pensionaction/undergraduate-service-learning-application/thank-you/
Disallow /preparedness/full-scale-exercise/full-scale-exercise-signup/thank-you/
Disallow /police/contact/report-a-crime-confidentially/thank-you/
Disallow /police/contact/umbpd-virtual-suggestion-box/thank-you/
Disallow /police/k9-beacon-request-form/
Disallow /police/k9-beacon-request-form/thank-you/
Disallow /uhi/e-newsletter-sign-up/thank-you/
Disallow /kevin-imported-news/
Disallow /accessibility-form/
Disallow /accessibility-form/accessibility-form-submissions/
Disallow /blacklivesmatter/
Disallow /campus-services-test/
Disallow /directory-profile/
Disallow /give/alumni-news/
Disallow /map/all-locations/
Disallow /map/buildings/
Disallow /media-library-links/
Disallow /ml/
Disallow /ml/our-people/
Disallow /ml/our-research-and-partnerships/
Disallow /ml/business-administration-mba/
Disallow /ml/graduate/
Disallow /ml/complete-your-application/
Disallow /ml/graduate-science-environment-programs/
Disallow /ml/policy-programs/
Disallow /ml/nursing-ms/
Disallow /ml/counseling-education-programs/
Disallow /ml/applied-linguistics-ma/
Disallow /ml/exercise-health-sciences-ms/
Disallow /ml/nurse-educator-certificate/
Disallow /ml/online-programs/
Disallow /ml/accounting-ms/
Disallow /ml/business-analytics-ms-certificate/
Disallow /ml/finance-ms/
Disallow /ml/cybersecurity-information-technology-programs/
Disallow /ml/liberal-arts-programs/
Disallow /ml/graduate-business-programs/
Disallow /ml/accelerated-bachelor-of-science-in-nursing/
Disallow /ml/nursing-rn-bs/
Disallow /ml/addictions-counselor-education-program/
Disallow /ml/spanish-english-translation-certificate/
Disallow /ml/sgisd-programs/
Disallow /ml/transfer-to-umb/
Disallow /ml/gerontology-programs/
Disallow /ml/for-the-times/
Disallow /ml/new-grad-student/
Disallow /ml/beacon-profile-kristol/
Disallow /ml/graduate-programs/
Disallow /ml/become-a-beacon/
Disallow /ml/transfer-to-umass-boston/
Disallow /common-header/
Disallow /common-header/search-bar/
Disallow /common-footer/
Disallow /footer-asset-references/
Disallow /search/
Disallow /terminalfour-training/
Disallow /test-pa/
Disallow /test-pa/performing-arts-faculty/
Disallow /test-pa/student-resources/
Disallow /test.umb.edu/
Disallow /uec/events/
Disallow /uec/special-events/
Disallow /uec/special-events/earthmonth/
Disallow /uec/special-events/earthmonth/quad-sustainability/
Disallow /uec/special-events/inauguration/inauguration-rsvp/thank-you/

Other Records

Field Value
crawl-delay 2

terminalfour nutch spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap https://www.umb.edu/sitemap-en.xml