mssm.org
robots.txt

Robots Exclusion Standard data for mssm.org

Resource Scan

Scan Details

Site Domain mssm.org
Base Domain mssm.org
Scan Status Ok
Last Scan2025-11-07T00:47:29+00:00
Next Scan 2025-12-07T00:47:29+00:00

Last Scan

Scanned2025-11-07T00:47:29+00:00
URL https://mssm.org/robots.txt
Redirect https://www.mssm.org/robots.txt
Redirect Domain www.mssm.org
Redirect Base mssm.org
Domain IPs 104.17.71.73
Redirect IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.164.123
Found Yes
Hash 7d5a57ef6e4ea092fc3ee029569d8685c668403ff2471efc05e3fb68f3c73fd2
SimHash f8543b4baff7

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /studentlife/family-weekend$
Disallow /studentlife/family-weekend?
Disallow /studentlife/family-weekend/~
Disallow /production/social-elements/youtube$
Disallow /production/social-elements/youtube?
Disallow /production/social-elements/youtube/~
Disallow /instructions/website-overview$
Disallow /instructions/website-overview?
Disallow /instructions/website-overview/~
Disallow /about-mssm/test$
Disallow /about-mssm/test?
Disallow /about-mssm/test/~
Disallow /store$
Disallow /store?
Disallow /store/~
Disallow /instructions/interior-page$
Disallow /instructions/interior-page?
Disallow /instructions/interior-page/~
Disallow /about-mssm/survey-responses$
Disallow /about-mssm/survey-responses?
Disallow /about-mssm/survey-responses/~
Disallow /students/key-club-service-auction$
Disallow /students/key-club-service-auction?
Disallow /students/key-club-service-auction/~
Disallow /bpa/custom-post-grid$
Disallow /bpa/custom-post-grid?
Disallow /bpa/custom-post-grid/~
Disallow /tiktok$
Disallow /tiktok?
Disallow /tiktok/~
Disallow /about-mssm/portrait-of-a-graduate$
Disallow /about-mssm/portrait-of-a-graduate?
Disallow /about-mssm/portrait-of-a-graduate/~
Disallow /studentlife/schedule$
Disallow /studentlife/schedule?
Disallow /studentlife/schedule/~
Disallow /bpa/infographic-2$
Disallow /bpa/infographic-2?
Disallow /bpa/infographic-2/~
Disallow /production/navigation/tier-three-page$
Disallow /production/navigation/tier-three-page?
Disallow /production/navigation/tier-three-page/~
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page$
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page?
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page/~
Disallow /summer/affording-summer-camp$
Disallow /summer/affording-summer-camp?
Disallow /summer/affording-summer-camp/~
Disallow /production/banners/left-right-banners$
Disallow /production/banners/left-right-banners?
Disallow /production/banners/left-right-banners/~
Disallow /summer/summer-camp$
Disallow /summer/summer-camp?
Disallow /summer/summer-camp/~
Disallow /production/posts/single$
Disallow /production/posts/single?
Disallow /production/posts/single/~
Disallow /production/posts/list$
Disallow /production/posts/list?
Disallow /production/posts/list/~
Disallow /summer/2024-camp$
Disallow /summer/2024-camp?
Disallow /summer/2024-camp/~
Disallow /summer/working-at-summer-camp$
Disallow /summer/working-at-summer-camp?
Disallow /summer/working-at-summer-camp/~
Disallow /production/calendar/slideshow$
Disallow /production/calendar/slideshow?
Disallow /production/calendar/slideshow/~
Disallow /production/calendar/list$
Disallow /production/calendar/list?
Disallow /production/calendar/list/~
Disallow /production/calendar/grid$
Disallow /production/calendar/grid?
Disallow /production/calendar/grid/~
Disallow /production/calendar/event$
Disallow /production/calendar/event?
Disallow /production/calendar/event/~
Disallow /production/constituent/directory$
Disallow /production/constituent/directory?
Disallow /production/constituent/directory/~
Disallow /production/constituent/students$
Disallow /production/constituent/students?
Disallow /production/constituent/students/~
Disallow /production/constituent/profile$
Disallow /production/constituent/profile?
Disallow /production/constituent/profile/~
Disallow /production/constituent/search$
Disallow /production/constituent/search?
Disallow /production/constituent/search/~
Disallow /summer/camp-faq$
Disallow /summer/camp-faq?
Disallow /summer/camp-faq/~
Disallow /summer/mobile-brochure$
Disallow /summer/mobile-brochure?
Disallow /summer/mobile-brochure/~
Disallow /summer/dorm-parent$
Disallow /summer/dorm-parent?
Disallow /summer/dorm-parent/~
Disallow /summer/scholarships$
Disallow /summer/scholarships?
Disallow /summer/scholarships/~
Disallow /campus-lifecommunity-handbookinformation-technology$
Disallow /campus-lifecommunity-handbookinformation-technology?
Disallow /campus-lifecommunity-handbookinformation-technology/~
Disallow /production/social-elements/vimeo$
Disallow /production/social-elements/vimeo?
Disallow /production/social-elements/vimeo/~
Disallow /production/social-elements/feeds$
Disallow /production/social-elements/feeds?
Disallow /production/social-elements/feeds/~
Disallow /backup-unoptimized-pages/admission-process-clone$
Disallow /backup-unoptimized-pages/admission-process-clone?
Disallow /backup-unoptimized-pages/admission-process-clone/~
Disallow /admission/virtual-open-house-resource-clone$
Disallow /admission/virtual-open-house-resource-clone?
Disallow /admission/virtual-open-house-resource-clone/~
Disallow /foundation/why-give$
Disallow /foundation/why-give?
Disallow /foundation/why-give/~
Disallow /foundation/community-grants-and-funds$
Disallow /foundation/community-grants-and-funds?
Disallow /foundation/community-grants-and-funds/~
Disallow /about-mssm/strategic-vision$
Disallow /about-mssm/strategic-vision?
Disallow /about-mssm/strategic-vision/~
Disallow /about-mssm/day-in-the-life$
Disallow /about-mssm/day-in-the-life?
Disallow /about-mssm/day-in-the-life/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /home-clone-september-27-2023$
Disallow /home-clone-september-27-2023?
Disallow /home-clone-september-27-2023/~
Disallow /new-page$
Disallow /new-page?
Disallow /new-page/~
Disallow /bpa$
Disallow /bpa?
Disallow /bpa/~
Disallow /admission/why-mssm$
Disallow /admission/why-mssm?
Disallow /admission/why-mssm/~
Disallow /admission/affording-mssm$
Disallow /admission/affording-mssm?
Disallow /admission/affording-mssm/~
Disallow /production/athletics/teams$
Disallow /production/athletics/teams?
Disallow /production/athletics/teams/~
Disallow /production/athletics/events-list$
Disallow /production/athletics/events-list?
Disallow /production/athletics/events-list/~
Disallow /production/athletics/single-event$
Disallow /production/athletics/single-event?
Disallow /production/athletics/single-event/~
Disallow /academics/senior-schedules$
Disallow /academics/senior-schedules?
Disallow /academics/senior-schedules/~
Disallow /academics/graduates-and-families$
Disallow /academics/graduates-and-families?
Disallow /academics/graduates-and-families/~
Disallow /studentlife/test-items/test-1$
Disallow /studentlife/test-items/test-1?
Disallow /studentlife/test-items/test-1/~
Disallow /about-mssm/equity-diversity$
Disallow /about-mssm/equity-diversity?
Disallow /about-mssm/equity-diversity/~
Disallow /production/navigation/tier-three-page/tier-four-page$
Disallow /production/navigation/tier-three-page/tier-four-page?
Disallow /production/navigation/tier-three-page/tier-four-page/~
Disallow /backup-unoptimized-pages$
Disallow /backup-unoptimized-pages?
Disallow /backup-unoptimized-pages/~
Disallow /summer$
Disallow /summer?
Disallow /summer/~
Disallow /staff$
Disallow /staff?
Disallow /staff/~
Disallow /backup-unoptimized-pages/academics-clone$
Disallow /backup-unoptimized-pages/academics-clone?
Disallow /backup-unoptimized-pages/academics-clone/~
Disallow /production/banners/left-banner$
Disallow /production/banners/left-banner?
Disallow /production/banners/left-banner/~
Disallow /production/banners/right-banner$
Disallow /production/banners/right-banner?
Disallow /production/banners/right-banner/~
Disallow /academics/ap-newsletter-updates-archive$
Disallow /academics/ap-newsletter-updates-archive?
Disallow /academics/ap-newsletter-updates-archive/~
Disallow /academics/day-in-the-life$
Disallow /academics/day-in-the-life?
Disallow /academics/day-in-the-life/~
Disallow /backup-unoptimized-pages/foundation-clone$
Disallow /backup-unoptimized-pages/foundation-clone?
Disallow /backup-unoptimized-pages/foundation-clone/~
Disallow /production/posts/grid$
Disallow /production/posts/grid?
Disallow /production/posts/grid/~
Disallow /production/posts/slideshow$
Disallow /production/posts/slideshow?
Disallow /production/posts/slideshow/~
Disallow /backup-unoptimized-pages/signature-strengths-of-mssm-students-clone$
Disallow /backup-unoptimized-pages/signature-strengths-of-mssm-students-clone?
Disallow /backup-unoptimized-pages/signature-strengths-of-mssm-students-clone/~
Disallow /studentlife/student-support$
Disallow /studentlife/student-support?
Disallow /studentlife/student-support/~
Disallow /studentlife/jra$
Disallow /studentlife/jra?
Disallow /studentlife/jra/~
Disallow /production/athletics/profile$
Disallow /production/athletics/profile?
Disallow /production/athletics/profile/~
Disallow /production/athletics/roster$
Disallow /production/athletics/roster?
Disallow /production/athletics/roster/~
Disallow /production/athletics/table$
Disallow /production/athletics/table?
Disallow /production/athletics/table/~
Disallow /backup-unoptimized-pages/mission-clone$
Disallow /backup-unoptimized-pages/mission-clone?
Disallow /backup-unoptimized-pages/mission-clone/~
Disallow /production/organizational/two-column$
Disallow /production/organizational/two-column?
Disallow /production/organizational/two-column/~
Disallow /production/organizational/three-column$
Disallow /production/organizational/three-column?
Disallow /production/organizational/three-column/~
Disallow /production/organizational/four-column$
Disallow /production/organizational/four-column?
Disallow /production/organizational/four-column/~
Disallow /production/organizational/container$
Disallow /production/organizational/container?
Disallow /production/organizational/container/~
Disallow /production/organizational/accordion$
Disallow /production/organizational/accordion?
Disallow /production/organizational/accordion/~
Disallow /production/organizational/tabs$
Disallow /production/organizational/tabs?
Disallow /production/organizational/tabs/~
Disallow /production/organizational/one-column$
Disallow /production/organizational/one-column?
Disallow /production/organizational/one-column/~
Disallow /studentlife/news-at-mssm$
Disallow /studentlife/news-at-mssm?
Disallow /studentlife/news-at-mssm/~
Disallow /studentlife/jra-e$
Disallow /studentlife/jra-e?
Disallow /studentlife/jra-e/~
Disallow /studentlife/howard-family-speaker-series-2$
Disallow /studentlife/howard-family-speaker-series-2?
Disallow /studentlife/howard-family-speaker-series-2/~
Disallow /production/page-layout/3-column-layout$
Disallow /production/page-layout/3-column-layout?
Disallow /production/page-layout/3-column-layout/~
Disallow /production/page-layout/1-column-layout$
Disallow /production/page-layout/1-column-layout?
Disallow /production/page-layout/1-column-layout/~
Disallow /production/page-layout/2-column-layout$
Disallow /production/page-layout/2-column-layout?
Disallow /production/page-layout/2-column-layout/~
Disallow /production/page-layout/two-column-bottom-right-sidebar$
Disallow /production/page-layout/two-column-bottom-right-sidebar?
Disallow /production/page-layout/two-column-bottom-right-sidebar/~
Disallow /production/page-layout/4-column-layout$
Disallow /production/page-layout/4-column-layout?
Disallow /production/page-layout/4-column-layout/~
Disallow /production/page-layout/two-columns-top$
Disallow /production/page-layout/two-columns-top?
Disallow /production/page-layout/two-columns-top/~
Disallow /production/page-layout/three-columns-top$
Disallow /production/page-layout/three-columns-top?
Disallow /production/page-layout/three-columns-top/~
Disallow /production/page-layout/two-columns-middle$
Disallow /production/page-layout/two-columns-middle?
Disallow /production/page-layout/two-columns-middle/~
Disallow /production/page-layout/three-columns-middle$
Disallow /production/page-layout/three-columns-middle?
Disallow /production/page-layout/three-columns-middle/~
Disallow /production/page-layout/one-column-over-two$
Disallow /production/page-layout/one-column-over-two?
Disallow /production/page-layout/one-column-over-two/~
Disallow /production/page-layout/two-column-bottom-left-sidebar$
Disallow /production/page-layout/two-column-bottom-left-sidebar?
Disallow /production/page-layout/two-column-bottom-left-sidebar/~
Disallow /production/page-layout/two-column-left-sidebar$
Disallow /production/page-layout/two-column-left-sidebar?
Disallow /production/page-layout/two-column-left-sidebar/~
Disallow /production/page-layout/two-column-right-sidebar$
Disallow /production/page-layout/two-column-right-sidebar?
Disallow /production/page-layout/two-column-right-sidebar/~
Disallow /production/page-layout/three-column-bottom$
Disallow /production/page-layout/three-column-bottom?
Disallow /production/page-layout/three-column-bottom/~
Disallow /production/qa-testing/qa-testing-content$
Disallow /production/qa-testing/qa-testing-content?
Disallow /production/qa-testing/qa-testing-content/~
Disallow /production/qa-testing/qa-testing-buttons$
Disallow /production/qa-testing/qa-testing-buttons?
Disallow /production/qa-testing/qa-testing-buttons/~
Disallow /production/style-guide/search$
Disallow /production/style-guide/search?
Disallow /production/style-guide/search/~
Disallow /production/style-guide/social-elements$
Disallow /production/style-guide/social-elements?
Disallow /production/style-guide/social-elements/~
Disallow /production/constituent$
Disallow /production/constituent?
Disallow /production/constituent/~
Disallow /production/banners$
Disallow /production/banners?
Disallow /production/banners/~
Disallow /production/calendar$
Disallow /production/calendar?
Disallow /production/calendar/~
Disallow /production/form$
Disallow /production/form?
Disallow /production/form/~
Disallow /production/login$
Disallow /production/login?
Disallow /production/login/~
Disallow /production/page-layout$
Disallow /production/page-layout?
Disallow /production/page-layout/~
Disallow /production/navigation$
Disallow /production/navigation?
Disallow /production/navigation/~
Disallow /production/posts$
Disallow /production/posts?
Disallow /production/posts/~
Disallow /production/resources$
Disallow /production/resources?
Disallow /production/resources/~
Disallow /production/style-guide/qa-testing$
Disallow /production/style-guide/qa-testing?
Disallow /production/style-guide/qa-testing/~
Disallow /production/athletics$
Disallow /production/athletics?
Disallow /production/athletics/~
Disallow /production/embed$
Disallow /production/embed?
Disallow /production/embed/~
Disallow /production/organizational$
Disallow /production/organizational?
Disallow /production/organizational/~

Comments

  • System Records
  • Custom Records
  • Page Exclusions

Warnings

  • 2 invalid lines.