Log In Sign Up

wearesrna.org
robots.txt

Robots Exclusion Standard data for wearesrna.org

Resource Scan

Scan Details

Site Domain wearesrna.org
Base Domain wearesrna.org
Scan Status Ok
Last Scan2025-08-21T19:59:30+00:00
Next Scan 2025-09-20T19:59:30+00:00

Last Scan

Scanned2025-08-21T19:59:30+00:00
URL https://wearesrna.org/robots.txt
Domain IPs 104.26.2.90, 104.26.3.90, 172.67.68.14, 2606:4700:20::681a:25a, 2606:4700:20::681a:35a, 2606:4700:20::ac43:440e
Response IP 172.67.68.14
Found Yes
Hash 496404280a823be8e5b7aa09d9b0ade156c01dcdf3eb6885dd5e3d84bfd3b515
SimHash fc1c144267a4

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

panscient.com
rogerbot
magpie-crawler
semrushbot
ahrefsbot
dotbot
mj12bot
barkrowler

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /?eventDisplay=past$
Disallow /*fwp_type_of_resource%3D
Disallow /*tribe-bar-date%3D
Disallow /*eventDisplay%3D
Disallow /*eventDate%3D
Disallow /*tribe_events_cat%3D
Disallow /*paged%3D
Disallow /*tribe_organizer%3D
Disallow /*post_type%3D
Disallow /*ical%3D
Disallow /*%26ical%3D1
Disallow /*?ical=1
Disallow /*?s
Disallow /events/day/
Disallow /events/week/
Disallow /events/month/
Disallow /events/today/
Disallow /events/photo/
Disallow /events/map/
Disallow /events/tag/
Disallow /events/category/
Disallow /events/
Disallow /topic/*/feed
Disallow /event/*/feed
Disallow /forum/
Disallow /calendar/
Disallow /venue/
Disallow /resources/page/
Disallow /category/
Disallow /page/
Disallow /tag/
Disallow /clinic/
Disallow /specialization/
Disallow /expertise/
Disallow /region/

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • artificial intelligence retrieval augmented generation or (2) with express
  • written permission from this site’s operator.
  • To request permission to license our intellectual
  • property and/or other materials, please contact this
  • site’s operator directly.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content
  • site search pages
  • temporary disable of /events, re-enable when cleared from google cache?
  • medical professional network tags
Back to top

Warnings

  • 1 invalid line.
Back to top