Log In Sign Up

northeast.mpschools.org
robots.txt

Robots Exclusion Standard data for northeast.mpschools.org

Resource Scan

Scan Details

Site Domain northeast.mpschools.org
Base Domain mpschools.org
Scan Status Ok
Last Scan2025-10-30T03:23:52+00:00
Next Scan 2025-11-29T03:23:52+00:00

Last Scan

Scanned2025-10-30T03:23:52+00:00
URL https://northeast.mpschools.org/robots.txt
Domain IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.163.123
Found Yes
Hash 7418551e67d66af9dceea479e08c1fc16278d19ee97327eb1bfe2eb89228f0dc
SimHash 7124a2418b33

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /instructions$
Disallow /instructions?
Disallow /instructions/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /instructions/style-guide$
Disallow /instructions/style-guide?
Disallow /instructions/style-guide/~
Disallow /instructions/homepage$
Disallow /instructions/homepage?
Disallow /instructions/homepage/~
Disallow /instructions/header-and-footer$
Disallow /instructions/header-and-footer?
Disallow /instructions/header-and-footer/~
Back to top

Comments

  • System Records
  • Custom Records
  • Page Exclusions
Back to top

Warnings

  • 2 invalid lines.
Back to top