Log In Sign Up

cwschools.org
robots.txt

Robots Exclusion Standard data for cwschools.org

Resource Scan

Scan Details

Site Domain cwschools.org
Base Domain cwschools.org
Scan Status Ok
Last Scan2025-09-25T08:16:05+00:00
Next Scan 2025-10-25T08:16:05+00:00

Last Scan

Scanned2025-09-25T08:16:05+00:00
URL https://cwschools.org/robots.txt
Redirect https://www.cwschools.org/robots.txt
Redirect Domain www.cwschools.org
Redirect Base cwschools.org
Domain IPs 104.17.67.73
Redirect IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.164.123
Found Yes
Hash e0ebe48e7e9e6e6ee496bba024ba9ca6037392d0a5d55f020673441a8875a863
SimHash fd16b6502fb2

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /about-us/when-we-started$
Disallow /about-us/when-we-started?
Disallow /about-us/when-we-started/~
Disallow /about-us/where-were-going$
Disallow /about-us/where-were-going?
Disallow /about-us/where-were-going/~
Disallow /instructions$
Disallow /instructions?
Disallow /instructions/~
Disallow /departments/human-resources/guest-teachers$
Disallow /departments/human-resources/guest-teachers?
Disallow /departments/human-resources/guest-teachers/~
Disallow /departments/human-resources/guest-teachers/cwhs-guest-teacher-resources$
Disallow /departments/human-resources/guest-teachers/cwhs-guest-teacher-resources?
Disallow /departments/human-resources/guest-teachers/cwhs-guest-teacher-resources/~
Disallow /departments/human-resources/guest-teachers/cwms-guest-teacher-resources-clone$
Disallow /departments/human-resources/guest-teachers/cwms-guest-teacher-resources-clone?
Disallow /departments/human-resources/guest-teachers/cwms-guest-teacher-resources-clone/~
Disallow /departments/human-resources/guest-teachers/wtes-guest-teacher-resources$
Disallow /departments/human-resources/guest-teachers/wtes-guest-teacher-resources?
Disallow /departments/human-resources/guest-teachers/wtes-guest-teacher-resources/~
Disallow /departments/human-resources/guest-teachers/ites-guest-teacher-resources$
Disallow /departments/human-resources/guest-teachers/ites-guest-teacher-resources?
Disallow /departments/human-resources/guest-teachers/ites-guest-teacher-resources/~
Disallow /about-us/blog$
Disallow /about-us/blog?
Disallow /about-us/blog/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /departments/teachingandlearning/the-cw-hub$
Disallow /departments/teachingandlearning/the-cw-hub?
Disallow /departments/teachingandlearning/the-cw-hub/~
Disallow /departments/mental-health-services/school-social-worker$
Disallow /departments/mental-health-services/school-social-worker?
Disallow /departments/mental-health-services/school-social-worker/~
Disallow /statefunding$
Disallow /statefunding?
Disallow /statefunding/~
Disallow /departments/superintendent/closings-and-delays$
Disallow /departments/superintendent/closings-and-delays?
Disallow /departments/superintendent/closings-and-delays/~
Disallow /about-us/who-we-are$
Disallow /about-us/who-we-are?
Disallow /about-us/who-we-are/~
Disallow /about-us/what-we-do$
Disallow /about-us/what-we-do?
Disallow /about-us/what-we-do/~
Disallow /about-us/why-were-here$
Disallow /about-us/why-were-here?
Disallow /about-us/why-were-here/~
Disallow /athletics/teams$
Disallow /athletics/teams?
Disallow /athletics/teams/~
Disallow /departments/preschool/preschool-coordinators-message$
Disallow /departments/preschool/preschool-coordinators-message?
Disallow /departments/preschool/preschool-coordinators-message/~
Disallow /departments/safety-and-security$
Disallow /departments/safety-and-security?
Disallow /departments/safety-and-security/~
Disallow /departments/human-resources/25-years-of-service-gift-selection$
Disallow /departments/human-resources/25-years-of-service-gift-selection?
Disallow /departments/human-resources/25-years-of-service-gift-selection/~
Disallow /home-clone-jun-23-2023$
Disallow /home-clone-jun-23-2023?
Disallow /home-clone-jun-23-2023/~
Disallow /departments/human-resources/30-years-of-service-gift-selection$
Disallow /departments/human-resources/30-years-of-service-gift-selection?
Disallow /departments/human-resources/30-years-of-service-gift-selection/~
Disallow /privacy-policy$
Disallow /privacy-policy?
Disallow /privacy-policy/~
Disallow /departments/communications/e-newsletter$
Disallow /departments/communications/e-newsletter?
Disallow /departments/communications/e-newsletter/~
Disallow /approved-designs$
Disallow /approved-designs?
Disallow /approved-designs/~
Disallow /icon-library$
Disallow /icon-library?
Disallow /icon-library/~
Disallow /instructions/homepage$
Disallow /instructions/homepage?
Disallow /instructions/homepage/~
Disallow /departments/human-resources/35-years-of-service-gift-selection$
Disallow /departments/human-resources/35-years-of-service-gift-selection?
Disallow /departments/human-resources/35-years-of-service-gift-selection/~
Disallow /departments/human-resources/20-years-of-service-gift-selection$
Disallow /departments/human-resources/20-years-of-service-gift-selection?
Disallow /departments/human-resources/20-years-of-service-gift-selection/~
Disallow /departments/human-resources/retirement-gift-selection$
Disallow /departments/human-resources/retirement-gift-selection?
Disallow /departments/human-resources/retirement-gift-selection/~
Back to top

Comments

  • System Records
  • Custom Records
  • Page Exclusions
Back to top

Warnings

  • 2 invalid lines.
Back to top