Log In Sign Up

siprep.org
robots.txt

Robots Exclusion Standard data for siprep.org

Resource Scan

Scan Details

Site Domain siprep.org
Base Domain siprep.org
Scan Status Ok
Last Scan2025-08-05T17:53:57+00:00
Next Scan 2025-09-04T17:53:57+00:00

Last Scan

Scanned2025-08-05T17:53:57+00:00
URL https://siprep.org/robots.txt
Redirect https://www.siprep.org/robots.txt
Redirect Domain www.siprep.org
Redirect Base siprep.org
Domain IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Redirect IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.165.123
Found Yes
Hash 2353b05a7d68624e6799bea21cc6e91d1af0840f1c25e96098761da69d2fc3f9
SimHash ece5c942f893

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /cf_enotify/
Disallow /cf_news/
Disallow /uploaded/

*

Rule Path
Disallow /giving/what-to-support/nlc-video-test$
Disallow /giving/what-to-support/nlc-video-test?
Disallow /giving/what-to-support/nlc-video-test/~
Disallow /website-instructions/alert-banners$
Disallow /website-instructions/alert-banners?
Disallow /website-instructions/alert-banners/~
Disallow /giving/honoring-donors/named-scholarships-fsa$
Disallow /giving/honoring-donors/named-scholarships-fsa?
Disallow /giving/honoring-donors/named-scholarships-fsa/~
Disallow /giving/what-to-support/nlc-test$
Disallow /giving/what-to-support/nlc-test?
Disallow /giving/what-to-support/nlc-test/~
Disallow /giving/what-to-support/naming-opportunities-test2$
Disallow /giving/what-to-support/naming-opportunities-test2?
Disallow /giving/what-to-support/naming-opportunities-test2/~
Disallow /giving/pledge-thanks$
Disallow /giving/pledge-thanks?
Disallow /giving/pledge-thanks/~
Disallow /giving/honoring-donors/presgala$
Disallow /giving/honoring-donors/presgala?
Disallow /giving/honoring-donors/presgala/~
Disallow /giving/honoring-donors/honoring-donors-test$
Disallow /giving/honoring-donors/honoring-donors-test?
Disallow /giving/honoring-donors/honoring-donors-test/~
Disallow /video$
Disallow /video?
Disallow /video/~
Disallow /giving/what-to-support/nlc/chapel$
Disallow /giving/what-to-support/nlc/chapel?
Disallow /giving/what-to-support/nlc/chapel/~
Disallow /giving/what-to-support/nlc/hub$
Disallow /giving/what-to-support/nlc/hub?
Disallow /giving/what-to-support/nlc/hub/~
Disallow /admissions/decide/choose-videos-clone$
Disallow /admissions/decide/choose-videos-clone?
Disallow /admissions/decide/choose-videos-clone/~
Disallow /giving/what-to-support/building-our-future-forward$
Disallow /giving/what-to-support/building-our-future-forward?
Disallow /giving/what-to-support/building-our-future-forward/~
Disallow /giving/what-to-support/naming-opportunities-test$
Disallow /giving/what-to-support/naming-opportunities-test?
Disallow /giving/what-to-support/naming-opportunities-test/~
Disallow /home-240105$
Disallow /home-240105?
Disallow /home-240105/~
Disallow /giving/what-to-support/naming-opportunities-test3$
Disallow /giving/what-to-support/naming-opportunities-test3?
Disallow /giving/what-to-support/naming-opportunities-test3/~
Disallow /giving/what-to-support/nlc/commons$
Disallow /giving/what-to-support/nlc/commons?
Disallow /giving/what-to-support/nlc/commons/~
Disallow /giving/what-to-support/nlc/lofts$
Disallow /giving/what-to-support/nlc/lofts?
Disallow /giving/what-to-support/nlc/lofts/~
Disallow /giving/honoring-donors/carlin/luncheon$
Disallow /giving/honoring-donors/carlin/luncheon?
Disallow /giving/honoring-donors/carlin/luncheon/~
Disallow /hero-test-3$
Disallow /hero-test-3?
Disallow /hero-test-3/~
Disallow /giving/what-to-support/nlc-clone$
Disallow /giving/what-to-support/nlc-clone?
Disallow /giving/what-to-support/nlc-clone/~
Disallow /genesis$
Disallow /genesis?
Disallow /genesis/~
Disallow /about/equity-inclusion-clone$
Disallow /about/equity-inclusion-clone?
Disallow /about/equity-inclusion-clone/~
Disallow /about/leadership-clone$
Disallow /about/leadership-clone?
Disallow /about/leadership-clone/~
Disallow /giving/what-to-support/nlc-v1$
Disallow /giving/what-to-support/nlc-v1?
Disallow /giving/what-to-support/nlc-v1/~
Disallow /giving/big-event$
Disallow /giving/big-event?
Disallow /giving/big-event/~
Disallow /give$
Disallow /give?
Disallow /give/~
Disallow /giving/what-to-support/nlc-faq$
Disallow /giving/what-to-support/nlc-faq?
Disallow /giving/what-to-support/nlc-faq/~
Disallow /giving/what-to-support/building-our-future-forward/nlc-faq$
Disallow /giving/what-to-support/building-our-future-forward/nlc-faq?
Disallow /giving/what-to-support/building-our-future-forward/nlc-faq/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /advent$
Disallow /advent?
Disallow /advent/~
Disallow /website-instructions/homepage$
Disallow /website-instructions/homepage?
Disallow /website-instructions/homepage/~
Disallow /transcript-request$
Disallow /transcript-request?
Disallow /transcript-request/~
Disallow /production/navigation/tier-three-page/tier-four-page$
Disallow /production/navigation/tier-three-page/tier-four-page?
Disallow /production/navigation/tier-three-page/tier-four-page/~
Disallow /home-231207$
Disallow /home-231207?
Disallow /home-231207/~
Disallow /directory-large$
Disallow /directory-large?
Disallow /directory-large/~
Disallow /giving/what-to-support/wts-test$
Disallow /giving/what-to-support/wts-test?
Disallow /giving/what-to-support/wts-test/~
Disallow /giving/how-to-give/how-to-give-clone$
Disallow /giving/how-to-give/how-to-give-clone?
Disallow /giving/how-to-give/how-to-give-clone/~
Disallow /production-clone$
Disallow /production-clone?
Disallow /production-clone/~
Disallow /template-6$
Disallow /template-6?
Disallow /template-6/~
Disallow /template-4$
Disallow /template-4?
Disallow /template-4/~
Disallow /production/form/forms-manager$
Disallow /production/form/forms-manager?
Disallow /production/form/forms-manager/~
Disallow /production/form/forms$
Disallow /production/form/forms?
Disallow /production/form/forms/~
Disallow /home-clone-may-11-2022$
Disallow /home-clone-may-11-2022?
Disallow /home-clone-may-11-2022/~
Disallow /admissions/welcome$
Disallow /admissions/welcome?
Disallow /admissions/welcome/~
Disallow /production/navigation/tier-three-page$
Disallow /production/navigation/tier-three-page?
Disallow /production/navigation/tier-three-page/~
Disallow /production-clone/pm-test$
Disallow /production-clone/pm-test?
Disallow /production-clone/pm-test/~
Disallow /production/page-layout/two-columns-top$
Disallow /production/page-layout/two-columns-top?
Disallow /production/page-layout/two-columns-top/~
Disallow /production/page-layout/one-column-over-two$
Disallow /production/page-layout/one-column-over-two?
Disallow /production/page-layout/one-column-over-two/~
Disallow /production/page-layout/three-columns-top$
Disallow /production/page-layout/three-columns-top?
Disallow /production/page-layout/three-columns-top/~
Disallow /production/page-layout/three-column-bottom$
Disallow /production/page-layout/three-column-bottom?
Disallow /production/page-layout/three-column-bottom/~
Disallow /production/page-layout/two-columns-middle$
Disallow /production/page-layout/two-columns-middle?
Disallow /production/page-layout/two-columns-middle/~
Disallow /production/page-layout/two-column-bottom-left-sidebar$
Disallow /production/page-layout/two-column-bottom-left-sidebar?
Disallow /production/page-layout/two-column-bottom-left-sidebar/~
Disallow /hero-test-2$
Disallow /hero-test-2?
Disallow /hero-test-2/~
Disallow /production/qa-testing/qa-testing-buttons$
Disallow /production/qa-testing/qa-testing-buttons?
Disallow /production/qa-testing/qa-testing-buttons/~
Disallow /production/qa-testing/qa-testing-content$
Disallow /production/qa-testing/qa-testing-content?
Disallow /production/qa-testing/qa-testing-content/~
Disallow /production/search$
Disallow /production/search?
Disallow /production/search/~
Disallow /production/athletics$
Disallow /production/athletics?
Disallow /production/athletics/~
Disallow /production/form$
Disallow /production/form?
Disallow /production/form/~
Disallow /production/embed$
Disallow /production/embed?
Disallow /production/embed/~
Disallow /hero-test-1$
Disallow /hero-test-1?
Disallow /hero-test-1/~
Disallow /giving/what-to-support/named-facilities-old$
Disallow /giving/what-to-support/named-facilities-old?
Disallow /giving/what-to-support/named-facilities-old/~
Disallow /hero-test-4$
Disallow /hero-test-4?
Disallow /hero-test-4/~
Disallow /hero-test-5$
Disallow /hero-test-5?
Disallow /hero-test-5/~
Disallow /website-instructions/image-sizes$
Disallow /website-instructions/image-sizes?
Disallow /website-instructions/image-sizes/~
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page$
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page?
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page/~
Disallow /website-instructions/interior-page-instructions$
Disallow /website-instructions/interior-page-instructions?
Disallow /website-instructions/interior-page-instructions/~
Disallow /quicklinks/giving$
Disallow /quicklinks/giving?
Disallow /quicklinks/giving/~
Disallow /quicklinks/news$
Disallow /quicklinks/news?
Disallow /quicklinks/news/~
Disallow /quicklinks/contact-us$
Disallow /quicklinks/contact-us?
Disallow /quicklinks/contact-us/~
Disallow /quicklinks/calendar$
Disallow /quicklinks/calendar?
Disallow /quicklinks/calendar/~
Disallow /giving/what-to-support/building-our-future-forward/lofts$
Disallow /giving/what-to-support/building-our-future-forward/lofts?
Disallow /giving/what-to-support/building-our-future-forward/lofts/~
Disallow /production/navigation$
Disallow /production/navigation?
Disallow /production/navigation/~
Disallow /production/social-elements$
Disallow /production/social-elements?
Disallow /production/social-elements/~
Disallow /production/qa-testing$
Disallow /production/qa-testing?
Disallow /production/qa-testing/~
Disallow /production/posts$
Disallow /production/posts?
Disallow /production/posts/~
Disallow /production/banners$
Disallow /production/banners?
Disallow /production/banners/~
Disallow /production/calendar$
Disallow /production/calendar?
Disallow /production/calendar/~
Disallow /production/page-layout$
Disallow /production/page-layout?
Disallow /production/page-layout/~
Disallow /giving/what-to-support/new-learning-commons$
Disallow /giving/what-to-support/new-learning-commons?
Disallow /giving/what-to-support/new-learning-commons/~
Disallow /quicklinks/good-neighbor$
Disallow /quicklinks/good-neighbor?
Disallow /quicklinks/good-neighbor/~
Disallow /production/constituent$
Disallow /production/constituent?
Disallow /production/constituent/~
Disallow /production/login$
Disallow /production/login?
Disallow /production/login/~
Disallow /production/resources$
Disallow /production/resources?
Disallow /production/resources/~
Disallow /quicklinks/employment$
Disallow /quicklinks/employment?
Disallow /quicklinks/employment/~
Disallow /giving/what-to-support/building-our-future-forward/commons$
Disallow /giving/what-to-support/building-our-future-forward/commons?
Disallow /giving/what-to-support/building-our-future-forward/commons/~
Disallow /giving/what-to-support/building-our-future-forward/hub$
Disallow /giving/what-to-support/building-our-future-forward/hub?
Disallow /giving/what-to-support/building-our-future-forward/hub/~
Disallow /giving/what-to-support/giving-day$
Disallow /giving/what-to-support/giving-day?
Disallow /giving/what-to-support/giving-day/~
Disallow /website-instructions/landing-page$
Disallow /website-instructions/landing-page?
Disallow /website-instructions/landing-page/~
Disallow /production/banners/left-banner$
Disallow /production/banners/left-banner?
Disallow /production/banners/left-banner/~
Disallow /production/banners/right-banner$
Disallow /production/banners/right-banner?
Disallow /production/banners/right-banner/~
Disallow /production/banners/left-right-banners$
Disallow /production/banners/left-right-banners?
Disallow /production/banners/left-right-banners/~
Disallow /production/posts/slideshow$
Disallow /production/posts/slideshow?
Disallow /production/posts/slideshow/~
Disallow /production/posts/list$
Disallow /production/posts/list?
Disallow /production/posts/list/~
Disallow /production/constituent/profile$
Disallow /production/constituent/profile?
Disallow /production/constituent/profile/~
Disallow /production/posts/grid$
Disallow /production/posts/grid?
Disallow /production/posts/grid/~
Disallow /production/constituent/search$
Disallow /production/constituent/search?
Disallow /production/constituent/search/~
Disallow /production/calendar/list$
Disallow /production/calendar/list?
Disallow /production/calendar/list/~
Disallow /production/posts/single$
Disallow /production/posts/single?
Disallow /production/posts/single/~
Disallow /production/calendar/grid$
Disallow /production/calendar/grid?
Disallow /production/calendar/grid/~
Disallow /production/calendar/slideshow$
Disallow /production/calendar/slideshow?
Disallow /production/calendar/slideshow/~
Disallow /production/calendar/event$
Disallow /production/calendar/event?
Disallow /production/calendar/event/~
Disallow /production/social-elements/vimeo$
Disallow /production/social-elements/vimeo?
Disallow /production/social-elements/vimeo/~
Disallow /production/social-elements/youtube$
Disallow /production/social-elements/youtube?
Disallow /production/social-elements/youtube/~
Disallow /website-instructions/perspectives-element$
Disallow /website-instructions/perspectives-element?
Disallow /website-instructions/perspectives-element/~
Disallow /template-2$
Disallow /template-2?
Disallow /template-2/~
Disallow /production/constituent/directory$
Disallow /production/constituent/directory?
Disallow /production/constituent/directory/~
Disallow /production/constituent/students$
Disallow /production/constituent/students?
Disallow /production/constituent/students/~
Disallow /about/news/story$
Disallow /about/news/story?
Disallow /about/news/story/~
Disallow /website-instructions$
Disallow /website-instructions?
Disallow /website-instructions/~
Disallow /giving/what-to-support/building-our-future-forward/chapel$
Disallow /giving/what-to-support/building-our-future-forward/chapel?
Disallow /giving/what-to-support/building-our-future-forward/chapel/~
Disallow /production/athletics/events-list$
Disallow /production/athletics/events-list?
Disallow /production/athletics/events-list/~
Disallow /production/athletics/single-event$
Disallow /production/athletics/single-event?
Disallow /production/athletics/single-event/~
Disallow /production/athletics/roster$
Disallow /production/athletics/roster?
Disallow /production/athletics/roster/~
Disallow /template-8$
Disallow /template-8?
Disallow /template-8/~
Disallow /production/athletics/teams$
Disallow /production/athletics/teams?
Disallow /production/athletics/teams/~
Disallow /production/athletics/profile$
Disallow /production/athletics/profile?
Disallow /production/athletics/profile/~
Disallow /production/athletics/table$
Disallow /production/athletics/table?
Disallow /production/athletics/table/~
Disallow /template-3$
Disallow /template-3?
Disallow /template-3/~
Disallow /production/organizational/tabs$
Disallow /production/organizational/tabs?
Disallow /production/organizational/tabs/~
Disallow /production/organizational/two-column$
Disallow /production/organizational/two-column?
Disallow /production/organizational/two-column/~
Disallow /production/organizational/three-column$
Disallow /production/organizational/three-column?
Disallow /production/organizational/three-column/~
Disallow /production/organizational/four-column$
Disallow /production/organizational/four-column?
Disallow /production/organizational/four-column/~
Disallow /production/organizational/accordion$
Disallow /production/organizational/accordion?
Disallow /production/organizational/accordion/~
Disallow /production/organizational/container$
Disallow /production/organizational/container?
Disallow /production/organizational/container/~
Disallow /school-calendars-2022$
Disallow /school-calendars-2022?
Disallow /school-calendars-2022/~
Disallow /template-9$
Disallow /template-9?
Disallow /template-9/~
Disallow /template-1$
Disallow /template-1?
Disallow /template-1/~
Disallow /production/page-layout/1-column-layout$
Disallow /production/page-layout/1-column-layout?
Disallow /production/page-layout/1-column-layout/~
Disallow /giving/honoring-donors/carlin/donors/donor$
Disallow /giving/honoring-donors/carlin/donors/donor?
Disallow /giving/honoring-donors/carlin/donors/donor/~
Disallow /production/page-layout/2-column-layout$
Disallow /production/page-layout/2-column-layout?
Disallow /production/page-layout/2-column-layout/~
Disallow /production/page-layout/3-column-layout$
Disallow /production/page-layout/3-column-layout?
Disallow /production/page-layout/3-column-layout/~
Disallow /production/page-layout/4-column-layout$
Disallow /production/page-layout/4-column-layout?
Disallow /production/page-layout/4-column-layout/~
Disallow /production/page-layout/three-columns-middle$
Disallow /production/page-layout/three-columns-middle?
Disallow /production/page-layout/three-columns-middle/~
Disallow /production/page-layout/two-column-bottom-right-sidebar$
Disallow /production/page-layout/two-column-bottom-right-sidebar?
Disallow /production/page-layout/two-column-bottom-right-sidebar/~
Disallow /production/page-layout/two-column-left-sidebar$
Disallow /production/page-layout/two-column-left-sidebar?
Disallow /production/page-layout/two-column-left-sidebar/~
Disallow /production/page-layout/two-column-right-sidebar$
Disallow /production/page-layout/two-column-right-sidebar?
Disallow /production/page-layout/two-column-right-sidebar/~
Disallow /production/organizational$
Disallow /production/organizational?
Disallow /production/organizational/~
Back to top

Comments

  • System Records
  • Custom Records
  • Page Exclusions
Back to top

Warnings

  • 2 invalid lines.
Back to top