events.stanford.edu
robots.txt

Robots Exclusion Standard data for events.stanford.edu

Resource Scan

Scan Details

Site Domain events.stanford.edu
Base Domain stanford.edu
Scan Status Ok
Last Scan2025-06-17T06:22:48+00:00
Next Scan 2025-07-17T06:22:48+00:00

Last Scan

Scanned2025-06-17T06:22:48+00:00
URL https://events.stanford.edu/robots.txt
Domain IPs 13.92.255.122
Response IP 13.92.255.122
Found Yes
Hash a0af61e24867b9b02d89042296280250fe1e2d4dcffb844dc1069917494bcb3c
SimHash 8ad5b55c75f4

Groups

*

Rule Path
Disallow /calendar/*?*types*
Disallow /*/calendar/*?*types*
Disallow /*/browse*?*types*
Disallow /*/calendar/200*
Disallow /*/calendar/2015*
Disallow /*/calendar/2016*
Disallow /*/calendar/2017*
Disallow /*/calendar/2018*
Disallow /*/calendar/2019*
Disallow /*/calendar/202*
Disallow /*/calendar/week
Disallow /*/calendar/three_months
Disallow /*/calendar/six_months
Disallow /*/calendar/year
Disallow /calendar/week
Disallow /calendar/month
Disallow /calendar/three_months
Disallow /calendar/six_months
Disallow /calendar/year
Disallow /event/confirm
Disallow /event/*/confirm
Disallow /event/unconfirm
Disallow /event/*/unconfirm
Disallow /event/get_attendees
Disallow /event/*/get_attendees
Disallow /event/watch_event
Disallow /event/*/watch_event
Disallow /event/create
Disallow /search
Disallow /photo/
Disallow /*/search
Disallow /*?utm
Disallow /signup?*
Disallow /auth/
Allow /
Allow /search/events.ics
Allow /search/events.xml
Allow /*/search/events.ics
Allow /*/search/events.xml
Allow /calendar/ics
Allow /calendar/xml
Allow /*/calendar/ics
Allow /*/calendar/xml
Allow /auth/login
Allow /auth/forgot

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • Disallow: /*/calendar/2013*
  • Disallow: /*/calendar/2014*
  • /*/calendar/month is intentionally skipped