Log In Sign Up

newarkunified.org
robots.txt

Robots Exclusion Standard data for newarkunified.org

Resource Scan

Scan Details

Site Domain newarkunified.org
Base Domain newarkunified.org
Scan Status Ok
Last Scan2025-08-20T22:12:42+00:00
Next Scan 2025-09-19T22:12:42+00:00

Last Scan

Scanned2025-08-20T22:12:42+00:00
URL https://newarkunified.org/robots.txt
Redirect https://www.newarkunified.org/robots.txt
Redirect Domain www.newarkunified.org
Redirect Base newarkunified.org
Domain IPs 104.21.50.7, 172.67.198.179, 2606:4700:3036::ac43:c6b3, 2606:4700:3037::6815:3207
Redirect IPs 104.21.50.7, 172.67.198.179, 2606:4700:3036::ac43:c6b3, 2606:4700:3037::6815:3207
Response IP 104.21.50.7
Found Yes
Hash c0ebab53262f6ae680b1f7b16c16e0b202f040efc1e2aefbdbeb40c945950dca
SimHash e165efd3bbd7

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /home-clone-224$
Disallow /home-clone-224?
Disallow /home-clone-224/~
Disallow /home-clone-220$
Disallow /home-clone-220?
Disallow /home-clone-220/~
Disallow /example-trustee-contact$
Disallow /example-trustee-contact?
Disallow /example-trustee-contact/~
Disallow /production/search$
Disallow /production/search?
Disallow /production/search/~
Disallow /production/news-elements$
Disallow /production/news-elements?
Disallow /production/news-elements/~
Disallow /onboarding-test$
Disallow /onboarding-test?
Disallow /onboarding-test/~
Disallow /production/organizational$
Disallow /production/organizational?
Disallow /production/organizational/~
Disallow /production/embed$
Disallow /production/embed?
Disallow /production/embed/~
Disallow /production/constituent$
Disallow /production/constituent?
Disallow /production/constituent/~
Disallow /production/form$
Disallow /production/form?
Disallow /production/form/~
Disallow /production/login$
Disallow /production/login?
Disallow /production/login/~
Disallow /home-clone-may-17-2021$
Disallow /home-clone-may-17-2021?
Disallow /home-clone-may-17-2021/~
Disallow /production/navigation/tier-three-page$
Disallow /production/navigation/tier-three-page?
Disallow /production/navigation/tier-three-page/~
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page$
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page?
Disallow /production/navigation/tier-three-page/tier-four-page/tier-five-page/~
Disallow /production/media$
Disallow /production/media?
Disallow /production/media/~
Disallow /production/navigation$
Disallow /production/navigation?
Disallow /production/navigation/~
Disallow /production/social-elements$
Disallow /production/social-elements?
Disallow /production/social-elements/~
Disallow /production/qa-testing$
Disallow /production/qa-testing?
Disallow /production/qa-testing/~
Disallow /departments/educational-services/educational-services-staff$
Disallow /departments/educational-services/educational-services-staff?
Disallow /departments/educational-services/educational-services-staff/~
Disallow /departments/business-services/purchasing/old-purchasing-past-projects$
Disallow /departments/business-services/purchasing/old-purchasing-past-projects?
Disallow /departments/business-services/purchasing/old-purchasing-past-projects/~
Disallow /departments/child-care-center/meet-the-team$
Disallow /departments/child-care-center/meet-the-team?
Disallow /departments/child-care-center/meet-the-team/~
Disallow /production/navigation/tier-three-page/tier-four-page$
Disallow /production/navigation/tier-three-page/tier-four-page?
Disallow /production/navigation/tier-three-page/tier-four-page/~
Disallow /production/calendar/list$
Disallow /production/calendar/list?
Disallow /production/calendar/list/~
Disallow /production/banners/left-right-banners$
Disallow /production/banners/left-right-banners?
Disallow /production/banners/left-right-banners/~
Disallow /district/staff/staff$
Disallow /district/staff/staff?
Disallow /district/staff/staff/~
Disallow /approved-designs$
Disallow /approved-designs?
Disallow /approved-designs/~
Disallow /departments/child-care-center/fees$
Disallow /departments/child-care-center/fees?
Disallow /departments/child-care-center/fees/~
Disallow /departments/business-services/purchasing/old-purchasing-for-contractors$
Disallow /departments/business-services/purchasing/old-purchasing-for-contractors?
Disallow /departments/business-services/purchasing/old-purchasing-for-contractors/~
Disallow /departments/all-departments$
Disallow /departments/all-departments?
Disallow /departments/all-departments/~
Disallow /departments/child-care-center/composer-basics-test$
Disallow /departments/child-care-center/composer-basics-test?
Disallow /departments/child-care-center/composer-basics-test/~
Disallow /production$
Disallow /production?
Disallow /production/~
Disallow /production/organizational/two-column$
Disallow /production/organizational/two-column?
Disallow /production/organizational/two-column/~
Disallow /production/organizational/three-column$
Disallow /production/organizational/three-column?
Disallow /production/organizational/three-column/~
Disallow /production/organizational/four-column$
Disallow /production/organizational/four-column?
Disallow /production/organizational/four-column/~
Disallow /production/organizational/accordion$
Disallow /production/organizational/accordion?
Disallow /production/organizational/accordion/~
Disallow /production/organizational/container$
Disallow /production/organizational/container?
Disallow /production/organizational/container/~
Disallow /production/organizational/tabs$
Disallow /production/organizational/tabs?
Disallow /production/organizational/tabs/~
Disallow /production/banners/right-banner$
Disallow /production/banners/right-banner?
Disallow /production/banners/right-banner/~
Disallow /production/banners/left-banner$
Disallow /production/banners/left-banner?
Disallow /production/banners/left-banner/~
Disallow /production/constituent/profile$
Disallow /production/constituent/profile?
Disallow /production/constituent/profile/~
Disallow /production/calendar/grid$
Disallow /production/calendar/grid?
Disallow /production/calendar/grid/~
Disallow /production/calendar/slideshow$
Disallow /production/calendar/slideshow?
Disallow /production/calendar/slideshow/~
Disallow /production/news-elements/news-list$
Disallow /production/news-elements/news-list?
Disallow /production/news-elements/news-list/~
Disallow /production/posts/list$
Disallow /production/posts/list?
Disallow /production/posts/list/~
Disallow /production/posts/grid$
Disallow /production/posts/grid?
Disallow /production/posts/grid/~
Disallow /production/posts/slideshow$
Disallow /production/posts/slideshow?
Disallow /production/posts/slideshow/~
Disallow /production/social-elements/vimeo$
Disallow /production/social-elements/vimeo?
Disallow /production/social-elements/vimeo/~
Disallow /production/posts/single$
Disallow /production/posts/single?
Disallow /production/posts/single/~
Disallow /production/calendar/event$
Disallow /production/calendar/event?
Disallow /production/calendar/event/~
Disallow /production/social-elements/youtube$
Disallow /production/social-elements/youtube?
Disallow /production/social-elements/youtube/~
Disallow /production/news-elements/news-post-page$
Disallow /production/news-elements/news-post-page?
Disallow /production/news-elements/news-post-page/~
Disallow /production/constituent/search$
Disallow /production/constituent/search?
Disallow /production/constituent/search/~
Disallow /production/constituent/students$
Disallow /production/constituent/students?
Disallow /production/constituent/students/~
Disallow /production/constituent/directory$
Disallow /production/constituent/directory?
Disallow /production/constituent/directory/~
Disallow /production/news-elements/news-grid$
Disallow /production/news-elements/news-grid?
Disallow /production/news-elements/news-grid/~
Disallow /production/news-elements/news-slideshow$
Disallow /production/news-elements/news-slideshow?
Disallow /production/news-elements/news-slideshow/~
Disallow /production/athletics/events-list$
Disallow /production/athletics/events-list?
Disallow /production/athletics/events-list/~
Disallow /production/athletics/single-event$
Disallow /production/athletics/single-event?
Disallow /production/athletics/single-event/~
Disallow /production/athletics/roster$
Disallow /production/athletics/roster?
Disallow /production/athletics/roster/~
Disallow /production/athletics/teams$
Disallow /production/athletics/teams?
Disallow /production/athletics/teams/~
Disallow /production/athletics/profile$
Disallow /production/athletics/profile?
Disallow /production/athletics/profile/~
Disallow /production/athletics/table$
Disallow /production/athletics/table?
Disallow /production/athletics/table/~
Disallow /production/page-layout/two-column-bottom-right-sidebar$
Disallow /production/page-layout/two-column-bottom-right-sidebar?
Disallow /production/page-layout/two-column-bottom-right-sidebar/~
Disallow /production/page-layout/two-column-right-sidebar$
Disallow /production/page-layout/two-column-right-sidebar?
Disallow /production/page-layout/two-column-right-sidebar/~
Disallow /production/page-layout/two-columns-middle$
Disallow /production/page-layout/two-columns-middle?
Disallow /production/page-layout/two-columns-middle/~
Disallow /production/page-layout/2-column-layout$
Disallow /production/page-layout/2-column-layout?
Disallow /production/page-layout/2-column-layout/~
Disallow /production/page-layout/1-column-layout$
Disallow /production/page-layout/1-column-layout?
Disallow /production/page-layout/1-column-layout/~
Disallow /production/page-layout/3-column-layout$
Disallow /production/page-layout/3-column-layout?
Disallow /production/page-layout/3-column-layout/~
Disallow /production/page-layout/4-column-layout$
Disallow /production/page-layout/4-column-layout?
Disallow /production/page-layout/4-column-layout/~
Disallow /production/page-layout/two-columns-top$
Disallow /production/page-layout/two-columns-top?
Disallow /production/page-layout/two-columns-top/~
Disallow /production/page-layout/one-column-over-two$
Disallow /production/page-layout/one-column-over-two?
Disallow /production/page-layout/one-column-over-two/~
Disallow /production/page-layout/three-columns-top$
Disallow /production/page-layout/three-columns-top?
Disallow /production/page-layout/three-columns-top/~
Disallow /production/page-layout/three-column-bottom$
Disallow /production/page-layout/three-column-bottom?
Disallow /production/page-layout/three-column-bottom/~
Disallow /production/page-layout/three-columns-middle$
Disallow /production/page-layout/three-columns-middle?
Disallow /production/page-layout/three-columns-middle/~
Disallow /production/page-layout/two-column-bottom-left-sidebar$
Disallow /production/page-layout/two-column-bottom-left-sidebar?
Disallow /production/page-layout/two-column-bottom-left-sidebar/~
Disallow /production/page-layout/two-column-left-sidebar$
Disallow /production/page-layout/two-column-left-sidebar?
Disallow /production/page-layout/two-column-left-sidebar/~
Disallow /production/posts$
Disallow /production/posts?
Disallow /production/posts/~
Disallow /production/banners$
Disallow /production/banners?
Disallow /production/banners/~
Disallow /production/page-layout$
Disallow /production/page-layout?
Disallow /production/page-layout/~
Disallow /production/athletics$
Disallow /production/athletics?
Disallow /production/athletics/~
Disallow /production/calendar$
Disallow /production/calendar?
Disallow /production/calendar/~
Disallow /production/qa-reports$
Disallow /production/qa-reports?
Disallow /production/qa-reports/~
Back to top

Comments

  • System Records
  • Custom Records
  • Page Exclusions
Back to top

Warnings

  • 2 invalid lines.
Back to top