www.fargo.k12.nd.us
robots.txt

Robots Exclusion Standard data for www.fargo.k12.nd.us

Resource Scan

Scan Details

Site Domain www.fargo.k12.nd.us
Base Domain k12.nd.us
Scan Status Ok
Last Scan2024-10-19T07:47:37+00:00
Next Scan 2024-11-18T07:47:37+00:00

Last Scan

Scanned2024-10-19T07:47:37+00:00
URL https://www.fargo.k12.nd.us/robots.txt
Domain IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.162.123
Found Yes
Hash 93bc56bebcfd1a6835c40b99cf9f4621ec35b952c007585d6e760c61ae587916
SimHash bd65648abad7

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /departments/nutrition-services-clone-test$
Disallow /departments/nutrition-services-clone-test?
Disallow /departments/nutrition-services-clone-test/~
Disallow /instructions$
Disallow /instructions?
Disallow /instructions/~
Disallow /ordered-list-test/ordered-lists-content-editor$
Disallow /ordered-list-test/ordered-lists-content-editor?
Disallow /ordered-list-test/ordered-lists-content-editor/~
Disallow /production/navigation/tier-three-page$
Disallow /production/navigation/tier-three-page?
Disallow /production/navigation/tier-three-page/~
Disallow /production/navigation/tier-three-page/tier-four-page$
Disallow /production/navigation/tier-three-page/tier-four-page?
Disallow /production/navigation/tier-three-page/tier-four-page/~
Disallow /elementary-resources/social-studies-nd-history/geology-geography-and-climate$
Disallow /elementary-resources/social-studies-nd-history/geology-geography-and-climate?
Disallow /elementary-resources/social-studies-nd-history/geology-geography-and-climate/~
Disallow /instructions/custom-classes$
Disallow /instructions/custom-classes?
Disallow /instructions/custom-classes/~
Disallow /departments/safety-emergency-management$
Disallow /departments/safety-emergency-management?
Disallow /departments/safety-emergency-management/~
Disallow /elementary-resources/social-studies-nd-history/social-studies-nd-history-welcome$
Disallow /elementary-resources/social-studies-nd-history/social-studies-nd-history-welcome?
Disallow /elementary-resources/social-studies-nd-history/social-studies-nd-history-welcome/~
Disallow /elementary-resources/social-studies-nd-history/tourism$
Disallow /elementary-resources/social-studies-nd-history/tourism?
Disallow /elementary-resources/social-studies-nd-history/tourism/~
Disallow /elementary-resources/social-studies-nd-history$
Disallow /elementary-resources/social-studies-nd-history?
Disallow /elementary-resources/social-studies-nd-history/~
Disallow /elementary-resources/social-studies-nd-history/animals$
Disallow /elementary-resources/social-studies-nd-history/animals?
Disallow /elementary-resources/social-studies-nd-history/animals/~
Disallow /elementary-resources/social-studies-nd-history/immigrant-history$
Disallow /elementary-resources/social-studies-nd-history/immigrant-history?
Disallow /elementary-resources/social-studies-nd-history/immigrant-history/~
Disallow /home-clone-february-20-2024$
Disallow /home-clone-february-20-2024?
Disallow /home-clone-february-20-2024/~
Disallow /layout-columns-test$
Disallow /layout-columns-test?
Disallow /layout-columns-test/~
Disallow /elementary-resources/social-studies-nd-history/letters-from-immigrants$
Disallow /elementary-resources/social-studies-nd-history/letters-from-immigrants?
Disallow /elementary-resources/social-studies-nd-history/letters-from-immigrants/~
Disallow /single-video$
Disallow /single-video?
Disallow /single-video/~
Disallow /elementary-resources/social-studies-nd-history/geography$
Disallow /elementary-resources/social-studies-nd-history/geography?
Disallow /elementary-resources/social-studies-nd-history/geography/~
Disallow /elementary-resources/social-studies-nd-history/native-americans$
Disallow /elementary-resources/social-studies-nd-history/native-americans?
Disallow /elementary-resources/social-studies-nd-history/native-americans/~
Disallow /elementary-resources/social-studies-nd-history/related-internet-sites$
Disallow /elementary-resources/social-studies-nd-history/related-internet-sites?
Disallow /elementary-resources/social-studies-nd-history/related-internet-sites/~
Disallow /elementary-resources/social-studies-nd-history/government$
Disallow /elementary-resources/social-studies-nd-history/government?
Disallow /elementary-resources/social-studies-nd-history/government/~
Disallow /production/calendar/grid$
Disallow /production/calendar/grid?
Disallow /production/calendar/grid/~
Disallow /production/calendar/slideshow$
Disallow /production/calendar/slideshow?
Disallow /production/calendar/slideshow/~
Disallow /single-hero$
Disallow /single-hero?
Disallow /single-hero/~
Disallow /production/calendar/event$
Disallow /production/calendar/event?
Disallow /production/calendar/event/~
Disallow /production/constituent/directory$
Disallow /production/constituent/directory?
Disallow /production/constituent/directory/~
Disallow /production/constituent/profile$
Disallow /production/constituent/profile?
Disallow /production/constituent/profile/~
Disallow /production/constituent/search$
Disallow /production/constituent/search?
Disallow /production/constituent/search/~
Disallow /production/constituent/students$
Disallow /production/constituent/students?
Disallow /production/constituent/students/~
Disallow /ordered-list-test$
Disallow /ordered-list-test?
Disallow /ordered-list-test/~
Disallow /l-test$
Disallow /l-test?
Disallow /l-test/~
Disallow /hp-hero-using-post$
Disallow /hp-hero-using-post?
Disallow /hp-hero-using-post/~
Disallow /production/posts/list$
Disallow /production/posts/list?
Disallow /production/posts/list/~
Disallow /production/posts/grid$
Disallow /production/posts/grid?
Disallow /production/posts/grid/~
Disallow /production/posts/slideshow$
Disallow /production/posts/slideshow?
Disallow /production/posts/slideshow/~
Disallow /production/posts/single$
Disallow /production/posts/single?
Disallow /production/posts/single/~
Disallow /production/social-elements/vimeo$
Disallow /production/social-elements/vimeo?
Disallow /production/social-elements/vimeo/~
Disallow /employment/missionstrategic-plan$
Disallow /employment/missionstrategic-plan?
Disallow /employment/missionstrategic-plan/~
Disallow /elementary-resources$
Disallow /elementary-resources?
Disallow /elementary-resources/~
Disallow /elementary-resources/social-studies-nd-history/agriculture-farm-life$
Disallow /elementary-resources/social-studies-nd-history/agriculture-farm-life?
Disallow /elementary-resources/social-studies-nd-history/agriculture-farm-life/~
Disallow /elementary-resources/social-studies-nd-history/manufacturing-industry$
Disallow /elementary-resources/social-studies-nd-history/manufacturing-industry?
Disallow /elementary-resources/social-studies-nd-history/manufacturing-industry/~
Disallow /elementary-resources/social-studies-nd-history/famous-north-dakotans$
Disallow /elementary-resources/social-studies-nd-history/famous-north-dakotans?
Disallow /elementary-resources/social-studies-nd-history/famous-north-dakotans/~
Disallow /production/athletics/table$
Disallow /production/athletics/table?
Disallow /production/athletics/table/~
Disallow /production/organizational/one-column$
Disallow /production/organizational/one-column?
Disallow /production/organizational/one-column/~
Disallow /production/organizational/two-column$
Disallow /production/organizational/two-column?
Disallow /production/organizational/two-column/~
Disallow /production/organizational/three-column$
Disallow /production/organizational/three-column?
Disallow /production/organizational/three-column/~
Disallow /production/organizational/four-column$
Disallow /production/organizational/four-column?
Disallow /production/organizational/four-column/~
Disallow /production/organizational/accordion$
Disallow /production/organizational/accordion?
Disallow /production/organizational/accordion/~
Disallow /production/organizational/container$
Disallow /production/organizational/container?
Disallow /production/organizational/container/~
Disallow /production/organizational/tabs$
Disallow /production/organizational/tabs?
Disallow /production/organizational/tabs/~
Disallow /approved-designs$
Disallow /approved-designs?
Disallow /approved-designs/~
Disallow /page-pop-sep-2024$
Disallow /page-pop-sep-2024?
Disallow /page-pop-sep-2024/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /production/page-layout/1-column-layout$
Disallow /production/page-layout/1-column-layout?
Disallow /production/page-layout/1-column-layout/~
Disallow /production/page-layout/two-column-left-sidebar$
Disallow /production/page-layout/two-column-left-sidebar?
Disallow /production/page-layout/two-column-left-sidebar/~
Disallow /production/page-layout/two-columns-top$
Disallow /production/page-layout/two-columns-top?
Disallow /production/page-layout/two-columns-top/~
Disallow /production/page-layout/one-column-over-two$
Disallow /production/page-layout/one-column-over-two?
Disallow /production/page-layout/one-column-over-two/~
Disallow /production/page-layout/three-columns-top$
Disallow /production/page-layout/three-columns-top?
Disallow /production/page-layout/three-columns-top/~
Disallow /production/page-layout/three-column-bottom$
Disallow /production/page-layout/three-column-bottom?
Disallow /production/page-layout/three-column-bottom/~
Disallow /production/page-layout/two-columns-middle$
Disallow /production/page-layout/two-columns-middle?
Disallow /production/page-layout/two-columns-middle/~
Disallow /production/page-layout/two-column-bottom-left-sidebar$
Disallow /production/page-layout/two-column-bottom-left-sidebar?
Disallow /production/page-layout/two-column-bottom-left-sidebar/~
Disallow /production/page-layout/two-column-right-sidebar$
Disallow /production/page-layout/two-column-right-sidebar?
Disallow /production/page-layout/two-column-right-sidebar/~
Disallow /production/page-layout/2-column-layout$
Disallow /production/page-layout/2-column-layout?
Disallow /production/page-layout/2-column-layout/~
Disallow /production/page-layout/3-column-layout$
Disallow /production/page-layout/3-column-layout?
Disallow /production/page-layout/3-column-layout/~
Disallow /production/page-layout/4-column-layout$
Disallow /production/page-layout/4-column-layout?
Disallow /production/page-layout/4-column-layout/~
Disallow /production/page-layout/three-columns-middle$
Disallow /production/page-layout/three-columns-middle?
Disallow /production/page-layout/three-columns-middle/~
Disallow /production/page-layout/two-column-bottom-right-sidebar$
Disallow /production/page-layout/two-column-bottom-right-sidebar?
Disallow /production/page-layout/two-column-bottom-right-sidebar/~
Disallow /production/qa-testing/qa-testing-content$
Disallow /production/qa-testing/qa-testing-content?
Disallow /production/qa-testing/qa-testing-content/~
Disallow /production/qa-testing/qa-testing-buttons$
Disallow /production/qa-testing/qa-testing-buttons?
Disallow /production/qa-testing/qa-testing-buttons/~
Disallow /production/qa-reports$
Disallow /production/qa-reports?
Disallow /production/qa-reports/~
Disallow /production/navigation$
Disallow /production/navigation?
Disallow /production/navigation/~
Disallow /production/login$
Disallow /production/login?
Disallow /production/login/~
Disallow /production/page-layout$
Disallow /production/page-layout?
Disallow /production/page-layout/~
Disallow /production/posts$
Disallow /production/posts?
Disallow /production/posts/~
Disallow /production/resources$
Disallow /production/resources?
Disallow /production/resources/~
Disallow /production/organizational$
Disallow /production/organizational?
Disallow /production/organizational/~
Disallow /production/form$
Disallow /production/form?
Disallow /production/form/~
Disallow /production/banners$
Disallow /production/banners?
Disallow /production/banners/~
Disallow /production/embed$
Disallow /production/embed?
Disallow /production/embed/~
Disallow /production/constituent$
Disallow /production/constituent?
Disallow /production/constituent/~
Disallow /production/social-elements$
Disallow /production/social-elements?
Disallow /production/social-elements/~
Disallow /production/qa-testing$
Disallow /production/qa-testing?
Disallow /production/qa-testing/~
Disallow /production/layout-element-test$
Disallow /production/layout-element-test?
Disallow /production/layout-element-test/~
Disallow /production/search$
Disallow /production/search?
Disallow /production/search/~
Disallow /production/calendar$
Disallow /production/calendar?
Disallow /production/calendar/~
Disallow /instructions/district-homepage$
Disallow /instructions/district-homepage?
Disallow /instructions/district-homepage/~
Disallow /instructions/interior-page$
Disallow /instructions/interior-page?
Disallow /instructions/interior-page/~
Disallow /instructions/image-sizes$
Disallow /instructions/image-sizes?
Disallow /instructions/image-sizes/~
Disallow /departments/student-activities/theater-box-office/2023-24-performance-season$
Disallow /departments/student-activities/theater-box-office/2023-24-performance-season?
Disallow /departments/student-activities/theater-box-office/2023-24-performance-season/~
Disallow /departments/teaching-learning$
Disallow /departments/teaching-learning?
Disallow /departments/teaching-learning/~
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page$
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page?
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page/~
Disallow /elementary-resources/dreambox$
Disallow /elementary-resources/dreambox?
Disallow /elementary-resources/dreambox/~
Disallow /production/banners/left-banner$
Disallow /production/banners/left-banner?
Disallow /production/banners/left-banner/~
Disallow /production/banners/right-banner$
Disallow /production/banners/right-banner?
Disallow /production/banners/right-banner/~
Disallow /production/banners/left-right-banners$
Disallow /production/banners/left-right-banners?
Disallow /production/banners/left-right-banners/~
Disallow /production/calendar/list$
Disallow /production/calendar/list?
Disallow /production/calendar/list/~
Disallow /production/social-elements/youtube$
Disallow /production/social-elements/youtube?
Disallow /production/social-elements/youtube/~
Disallow /production/social-elements/feeds$
Disallow /production/social-elements/feeds?
Disallow /production/social-elements/feeds/~
Disallow /production/athletics/events-list$
Disallow /production/athletics/events-list?
Disallow /production/athletics/events-list/~
Disallow /production/athletics/single-event$
Disallow /production/athletics/single-event?
Disallow /production/athletics/single-event/~
Disallow /production/athletics/roster$
Disallow /production/athletics/roster?
Disallow /production/athletics/roster/~
Disallow /production/athletics/teams$
Disallow /production/athletics/teams?
Disallow /production/athletics/teams/~
Disallow /production/athletics/profile$
Disallow /production/athletics/profile?
Disallow /production/athletics/profile/~
Disallow /production/athletics$
Disallow /production/athletics?
Disallow /production/athletics/~

Comments

  • System Records
  • Custom Records
  • Page Exclusions

Warnings

  • 2 invalid lines.