every.org
robots.txt

Robots Exclusion Standard data for every.org

Resource Scan

Scan Details

Site Domain every.org
Base Domain every.org
Scan Status Ok
Last Scan2024-09-26T12:24:40+00:00
Next Scan 2024-10-26T12:24:40+00:00

Last Scan

Scanned2024-09-26T12:24:40+00:00
URL https://every.org/robots.txt
Redirect https://www.every.org/robots.txt
Redirect Domain www.every.org
Redirect Base every.org
Domain IPs 104.20.46.47, 104.20.47.47, 2606:4700:10::6814:2e2f, 2606:4700:10::6814:2f2f
Redirect IPs 76.76.21.164, 76.76.21.9
Response IP 76.76.21.142
Found Yes
Hash 986a8208b46455f4fc8a131fce376dfa8dbafce46e6808ac80de1f97cabeedf5
SimHash d028dad0eb13

Groups

*

Rule Path
Allow /
Allow /search?*
Disallow /*?
Disallow /*/admin
Disallow /*/configure-button
Disallow /*/edit
Disallow /*/button
Disallow /*/followers
Disallow /*/following
Disallow /signup
Disallow /login
Disallow /join/
Disallow /reset-password
Disallow /my-giving
Disallow /new-nonprofit
Disallow /invite
Disallow /stripe
Disallow /api/
Disallow /auth/
Disallow /emailPreviews/
Disallow /emailpreviews/
Disallow /webhooks/
Disallow /internalIo/
Disallow /internalio/

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.every.org/sitemaps/sitemap-index.xml