washburn.mpschools.org
robots.txt

Robots Exclusion Standard data for washburn.mpschools.org

Resource Scan

Scan Details

Site Domain washburn.mpschools.org
Base Domain mpschools.org
Scan Status Ok
Last Scan2025-08-30T14:28:46+00:00
Next Scan 2025-09-29T14:28:46+00:00

Last Scan

Scanned2025-08-30T14:28:46+00:00
URL https://washburn.mpschools.org/robots.txt
Domain IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.163.123
Found Yes
Hash c6e32e7ef36da179b7ed726999682fbc7d46a105a63456211ab95c813a5d810a
SimHash 71a492418b32

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /activities-athletics/athletics/spring-sports/ultimate-frisbee$
Disallow /activities-athletics/athletics/spring-sports/ultimate-frisbee?
Disallow /activities-athletics/athletics/spring-sports/ultimate-frisbee/~
Disallow /instructions/style-guide$
Disallow /instructions/style-guide?
Disallow /instructions/style-guide/~
Disallow /instructions/header-and-footer$
Disallow /instructions/header-and-footer?
Disallow /instructions/header-and-footer/~
Disallow /instructions/homepage$
Disallow /instructions/homepage?
Disallow /instructions/homepage/~
Disallow /home-clone$
Disallow /home-clone?
Disallow /home-clone/~
Disallow /about/livestream$
Disallow /about/livestream?
Disallow /about/livestream/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /about/alumni/class-of-1994$
Disallow /about/alumni/class-of-1994?
Disallow /about/alumni/class-of-1994/~
Disallow /instructions$
Disallow /instructions?
Disallow /instructions/~

Comments

  • System Records
  • Custom Records
  • Page Exclusions

Warnings

  • 2 invalid lines.