cs.jhu.edu
robots.txt

Robots Exclusion Standard data for cs.jhu.edu

Resource Scan

Scan Details

Site Domain cs.jhu.edu
Base Domain jhu.edu
Scan Status Ok
Last Scan2025-06-07T17:01:17+00:00
Next Scan 2025-07-07T17:01:17+00:00

Last Scan

Scanned2025-06-07T17:01:17+00:00
URL https://cs.jhu.edu/robots.txt
Redirect https://www.cs.jhu.edu/robots.txt
Redirect Domain www.cs.jhu.edu
Redirect Base jhu.edu
Domain IPs 128.220.13.64
Redirect IPs 128.220.13.64
Response IP 128.220.13.64
Found Yes
Hash ac770a9516a26d50bad270528d12d08adfecdc008666376b20db7aaeac098d48
SimHash e48c6dd0e90b

Groups

ia_archiver

Rule Path
Disallow /~ateniese/
Disallow /~ateniese
Disallow /~jason/tmp

*

Rule Path
Disallow /news-events/calendar/action~posterboard/
Disallow /news-events/calendar/action~agenda/
Disallow /news-events/calendar/action~oneday/
Disallow /news-events/calendar/action~month/
Disallow /news-events/calendar/action~week/
Disallow /news-events/calendar/action~stream/
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/