donorschoose.org
robots.txt

Robots Exclusion Standard data for donorschoose.org

Resource Scan

Scan Details

Site Domain donorschoose.org
Base Domain donorschoose.org
Scan Status Ok
Last Scan2024-05-24T05:36:26+00:00
Next Scan 2024-06-23T05:36:26+00:00

Last Scan

Scanned2024-05-24T05:36:26+00:00
URL https://donorschoose.org/robots.txt
Redirect https://www.donorschoose.org/robots.txt
Redirect Domain www.donorschoose.org
Redirect Base donorschoose.org
Domain IPs 151.101.130.49, 151.101.194.49, 151.101.2.49, 151.101.66.49
Redirect IPs 199.232.194.49, 199.232.198.49
Response IP 146.75.42.49
Found Yes
Hash 12c6e6b7319cb90d1bdb78de53955d01b49c8696f6ef0950d596dd28f9256bde
SimHash a85f81d6e7f3

Groups

*

Rule Path
Disallow /admin/
Disallow /images/user/uploads/
Disallow /images/proposal/uploads/
Disallow /jspspellcheck/
Disallow /onlineopinionF3cS/
Disallow /wizard/
Disallow /common/add_school_widget.html
Disallow /common/follow_list.html
Disallow /common/mmi_update.html
Disallow /common/wishlist_update.html
Disallow /donors/donation.html
Disallow /donors/print_proposal.html
Disallow /donors/add_to_registry.html
Disallow /donors/add_to_challenge.html
Disallow /html/widgets/school_widget.html
Disallow /projects/search.html
Disallow /donors/send_friend.html
Disallow /donors/send.html
Disallow /donors/share_schoolpage.html
Disallow /donors/send_topgiving.html
Disallow /donors/givingCart.html
Disallow /common/sorry
Disallow /html/sorry
Disallow /docs/sorry
Disallow /common/json_feed.html
Disallow /donors/proposal_picker.html
Disallow /donors/viewChallenge.html?*&*
Disallow /donors/viewChallenge.html?a
Disallow /donors/viewChallenge.html?b
Disallow /donors/viewChallenge.html?c
Disallow /donors/viewChallenge.html?d
Disallow /donors/viewChallenge.html?e
Disallow /donors/viewChallenge.html?f
Disallow /donors/viewChallenge.html?g
Disallow /donors/viewChallenge.html?h
Disallow /donors/viewChallenge.html?j
Disallow /donors/viewChallenge.html?k
Disallow /donors/viewChallenge.html?l
Disallow /donors/viewChallenge.html?m
Disallow /donors/viewChallenge.html?n
Disallow /donors/viewChallenge.html?o
Disallow /donors/viewChallenge.html?p
Disallow /donors/viewChallenge.html?q
Disallow /donors/viewChallenge.html?r
Disallow /donors/viewChallenge.html?s
Disallow /donors/viewChallenge.html?t
Disallow /donors/viewChallenge.html?u
Disallow /donors/viewChallenge.html?v
Disallow /donors/viewChallenge.html?w
Disallow /donors/viewChallenge.html?x
Disallow /donors/viewChallenge.html?y
Disallow /donors/viewChallenge.html?z
Disallow /donors/viewChallenge.html?ia
Disallow /donors/viewChallenge.html?ib
Disallow /donors/viewChallenge.html?ic
Disallow /donors/viewChallenge.html?ie
Disallow /donors/viewChallenge.html?if
Disallow /donors/viewChallenge.html?ig
Disallow /donors/viewChallenge.html?ih
Disallow /donors/viewChallenge.html?ii
Disallow /donors/viewChallenge.html?ij
Disallow /donors/viewChallenge.html?ik
Disallow /donors/viewChallenge.html?il
Disallow /donors/viewChallenge.html?im
Disallow /donors/viewChallenge.html?in
Disallow /donors/viewChallenge.html?io
Disallow /donors/viewChallenge.html?ip
Disallow /donors/viewChallenge.html?iq
Disallow /donors/viewChallenge.html?ir
Disallow /donors/viewChallenge.html?is
Disallow /donors/viewChallenge.html?it
Disallow /donors/viewChallenge.html?iu
Disallow /donors/viewChallenge.html?iv
Disallow /donors/viewChallenge.html?iw
Disallow /donors/viewChallenge.html?ix
Disallow /donors/viewChallenge.html?iy
Disallow /donors/viewChallenge.html?iz
Disallow /donors/search.html?*
Allow /donors/search.html?landing=true&*

Other Records

Field Value
sitemap https://www.donorschoose.org/teacher-sitemap-index.xml
sitemap https://www.donorschoose.org/challenge-givingpage-sitemap-index.xml
sitemap https://www.donorschoose.org/district-givingpage-sitemap-index.xml
sitemap https://www.donorschoose.org/giftcodechallenge-givingpage-sitemap-index.xml
sitemap https://www.donorschoose.org/matchingchallenge-givingpage-sitemap-index.xml
sitemap https://www.donorschoose.org/project-2022-sitemap-index.xml
sitemap https://www.donorschoose.org/project-2023-sitemap-index.xml
sitemap https://www.donorschoose.org/project-2024-sitemap-index.xml
sitemap https://www.donorschoose.org/explore-sitemap.xml.gz
sitemap https://www.donorschoose.org/about-sitemap.xml.gz
sitemap https://www.donorschoose.org/state-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-alabama-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-alaska-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-arizona-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-arkansas-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-california-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-colorado-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-connecticut-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-delaware-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-district-of-columbia-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-florida-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-georgia-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-hawaii-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-idaho-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-illinois-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-indiana-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-iowa-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-kansas-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-kentucky-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-louisiana-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-maine-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-maryland-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-massachusetts-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-michigan-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-minnesota-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-mississippi-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-missouri-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-montana-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-nebraska-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-nevada-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-new-hampshire-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-new-jersey-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-new-mexico-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-new-york-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-north-carolina-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-north-dakota-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-ohio-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-oklahoma-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-oregon-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-pennsylvania-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-rhode-island-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-south-carolina-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-south-dakota-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-tennessee-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-texas-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-utah-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-vermont-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-virginia-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-washington-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-west-virginia-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-wisconsin-sitemap.xml.gz
sitemap https://www.donorschoose.org/district-wyoming-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-alabama-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-alaska-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-arizona-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-arkansas-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-california-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-colorado-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-connecticut-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-delaware-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-district-of-columbia-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-florida-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-georgia-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-hawaii-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-idaho-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-illinois-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-indiana-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-iowa-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-kansas-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-kentucky-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-louisiana-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-maine-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-maryland-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-massachusetts-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-michigan-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-minnesota-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-mississippi-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-missouri-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-montana-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-nebraska-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-nevada-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-new-hampshire-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-new-jersey-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-new-mexico-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-new-york-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-north-carolina-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-north-dakota-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-ohio-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-oklahoma-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-oregon-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-pennsylvania-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-rhode-island-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-south-carolina-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-south-dakota-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-tennessee-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-texas-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-utah-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-vermont-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-virginia-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-washington-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-west-virginia-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-wisconsin-sitemap.xml.gz
sitemap https://www.donorschoose.org/school-wyoming-sitemap.xml.gz

Comments

  • This is the production robots.txt file that allows all robots to crawl (with guidance to avoid getting trapped).
  • This will only work for well-behaved robots, so it may be necessary to escalate to
  • 403 Forbidden responses in the redirects.conf file.
  • Block some UX content that shouldn't be in search engines.
  • Robots should never create shopping carts:
  • Robots should never crawl our sorry pages during BRS outages:
  • Robots should never create search-like pages that aren't search.html:
  • KID-GLOVE RULES FOR CHALLENGE PAGES
  • Allow only id=* /donors/viewChallenge.html pages.
  • Do not allow multiple params on /donors/viewChallenge.html pages
  • Disallow params with an initial letter other than i.
  • We should only allow id=*, so treat other i* carefully.
  • DO NOT Disallow: /donors/viewChallenge.html?id=
  • Disallow first 2 letters i_ where _ other than d.
  • KID-GLOVE RULES FOR SEARCH PAGES
  • Do not allow any views on /donors/search.html pages, except for landing pages
  • Sitemaps