Log In Sign Up

headroyce.org
robots.txt

Robots Exclusion Standard data for headroyce.org

Resource Scan

Scan Details

Site Domain headroyce.org
Base Domain headroyce.org
Scan Status Ok
Last Scan2025-10-04T00:02:07+00:00
Next Scan 2025-11-03T00:02:07+00:00

Last Scan

Scanned2025-10-04T00:02:07+00:00
URL https://headroyce.org/robots.txt
Redirect https://www.headroyce.org/robots.txt
Redirect Domain www.headroyce.org
Redirect Base headroyce.org
Domain IPs 104.17.67.73
Redirect IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.165.123
Found Yes
Hash eb23ae251f82af0274f812ddff41c2d3ceac4af6ce204cb1bacb1c85cbe9488a
SimHash 5714a273879c

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /cf_enotify/

*

Rule Path
Disallow /community/directory-clone$
Disallow /community/directory-clone?
Disallow /community/directory-clone/~
Disallow /annual-report/2024$
Disallow /annual-report/2024?
Disallow /annual-report/2024/~
Disallow /new-page-june-2025$
Disallow /new-page-june-2025?
Disallow /new-page-june-2025/~
Disallow /connect$
Disallow /connect?
Disallow /connect/~
Disallow /fs-test-diversity-clone$
Disallow /fs-test-diversity-clone?
Disallow /fs-test-diversity-clone/~
Disallow /giving/recurring-giving$
Disallow /giving/recurring-giving?
Disallow /giving/recurring-giving/~
Disallow /location-demo$
Disallow /location-demo?
Disallow /location-demo/~
Disallow /home-clone12$
Disallow /home-clone12?
Disallow /home-clone12/~
Disallow /404-page-not-found$
Disallow /404-page-not-found?
Disallow /404-page-not-found/~
Disallow /life-head-royce/news-and-publications/birds-eye-view-news$
Disallow /life-head-royce/news-and-publications/birds-eye-view-news?
Disallow /life-head-royce/news-and-publications/birds-eye-view-news/~
Disallow /giving/ways-to-give$
Disallow /giving/ways-to-give?
Disallow /giving/ways-to-give/~
Disallow /annual-report/2022$
Disallow /annual-report/2022?
Disallow /annual-report/2022/~
Disallow /admissions/paper-fortune-teller$
Disallow /admissions/paper-fortune-teller?
Disallow /admissions/paper-fortune-teller/~
Disallow /about-us/south-campus/welcome-center$
Disallow /about-us/south-campus/welcome-center?
Disallow /about-us/south-campus/welcome-center/~
Disallow /sustainability-clone$
Disallow /sustainability-clone?
Disallow /sustainability-clone/~
Disallow /admissions/events$
Disallow /admissions/events?
Disallow /admissions/events/~
Disallow /admissions/new-family-welcome$
Disallow /admissions/new-family-welcome?
Disallow /admissions/new-family-welcome/~
Disallow /air-quality$
Disallow /air-quality?
Disallow /air-quality/~
Disallow /annual-report$
Disallow /annual-report?
Disallow /annual-report/~
Disallow /pathwaystopurpose$
Disallow /pathwaystopurpose?
Disallow /pathwaystopurpose/~
Disallow /about-us/south-campus/collaboration-center$
Disallow /about-us/south-campus/collaboration-center?
Disallow /about-us/south-campus/collaboration-center/~
Disallow /admissions/admitted-families$
Disallow /admissions/admitted-families?
Disallow /admissions/admitted-families/~
Disallow /community/directory/new-faces$
Disallow /community/directory/new-faces?
Disallow /community/directory/new-faces/~
Disallow /about-us/south-campus/stem-center$
Disallow /about-us/south-campus/stem-center?
Disallow /about-us/south-campus/stem-center/~
Disallow /annual-report/2019$
Disallow /annual-report/2019?
Disallow /annual-report/2019/~
Disallow /annual-report/2023$
Disallow /annual-report/2023?
Disallow /annual-report/2023/~
Disallow /about-us/south-campus/outdoor-education$
Disallow /about-us/south-campus/outdoor-education?
Disallow /about-us/south-campus/outdoor-education/~
Disallow /about-us/strategic-plan$
Disallow /about-us/strategic-plan?
Disallow /about-us/strategic-plan/~
Disallow /fade$
Disallow /fade?
Disallow /fade/~
Disallow /sustainability-clone2$
Disallow /sustainability-clone2?
Disallow /sustainability-clone2/~
Disallow /testtesttest$
Disallow /testtesttest?
Disallow /testtesttest/~
Disallow /new-family-welcome-clone-49$
Disallow /new-family-welcome-clone-49?
Disallow /new-family-welcome-clone-49/~
Disallow /life-head-royce/events$
Disallow /life-head-royce/events?
Disallow /life-head-royce/events/~
Disallow /production/full-width-panels$
Disallow /production/full-width-panels?
Disallow /production/full-width-panels/~
Disallow /production/callout-boxes$
Disallow /production/callout-boxes?
Disallow /production/callout-boxes/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /transportation$
Disallow /transportation?
Disallow /transportation/~
Disallow /about-us/bridge2022$
Disallow /about-us/bridge2022?
Disallow /about-us/bridge2022/~
Disallow /mobile-app-support$
Disallow /mobile-app-support?
Disallow /mobile-app-support/~
Disallow /home-clone-ss-2024$
Disallow /home-clone-ss-2024?
Disallow /home-clone-ss-2024/~
Disallow /campaign$
Disallow /campaign?
Disallow /campaign/~
Disallow /2019-homepage-site-notes$
Disallow /2019-homepage-site-notes?
Disallow /2019-homepage-site-notes/~
Disallow /mobile-app-privacy-policy$
Disallow /mobile-app-privacy-policy?
Disallow /mobile-app-privacy-policy/~
Disallow /giving/pledge$
Disallow /giving/pledge?
Disallow /giving/pledge/~
Disallow /life-head-royce/student-support-services/learning-differences-network-ldn$
Disallow /life-head-royce/student-support-services/learning-differences-network-ldn?
Disallow /life-head-royce/student-support-services/learning-differences-network-ldn/~
Disallow /annual-report/2021$
Disallow /annual-report/2021?
Disallow /annual-report/2021/~
Disallow /about-us/heads-welcome/inquiry-inspiration-blog$
Disallow /about-us/heads-welcome/inquiry-inspiration-blog?
Disallow /about-us/heads-welcome/inquiry-inspiration-blog/~
Disallow /about-us/heads-welcome/jayhawk-journal-heads-corner$
Disallow /about-us/heads-welcome/jayhawk-journal-heads-corner?
Disallow /about-us/heads-welcome/jayhawk-journal-heads-corner/~
Disallow /parent-portal-clone$
Disallow /parent-portal-clone?
Disallow /parent-portal-clone/~
Disallow /academics-old$
Disallow /academics-old?
Disallow /academics-old/~
Disallow /life-head-royce/cce/mentorship$
Disallow /life-head-royce/cce/mentorship?
Disallow /life-head-royce/cce/mentorship/~
Back to top

Comments

  • System Records
  • Custom Records
  • Page Exclusions
Back to top

Warnings

  • 2 invalid lines.
Back to top