advanced.jhu.edu
robots.txt

Robots Exclusion Standard data for advanced.jhu.edu

Resource Scan

Scan Details

Site Domain advanced.jhu.edu
Base Domain jhu.edu
Scan Status Ok
Last Scan2025-06-01T20:25:44+00:00
Next Scan 2025-07-01T20:25:44+00:00

Last Scan

Scanned2025-06-01T20:25:44+00:00
URL https://advanced.jhu.edu/robots.txt
Domain IPs 104.18.40.111, 172.64.147.145, 2606:4700:4400::6812:286f, 2606:4700:4400::ac40:9391
Response IP 172.64.147.145
Found Yes
Hash 00dd7b734d5f909401c0bfba2e62fced88ba3ff87d3d94996bd9e8984f7682e1
SimHash e294fc4282b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /fastspot-test-pages/flexible-content-video/
Disallow /fastspot-test-pages/
Disallow /fastspot-test-pages/countdown-clock/
Disallow /fastspot-test-pages/test-aap-online-add-drop-form/
Disallow /fastspot-test-pages/example-course-listing/
Disallow /fastspot-test-pages/flexible-content-image/
Disallow /fastspot-test-pages/full-width-components/
Disallow /fastspot-test-pages/example-program-page/
Disallow /ksas-masters-ceremony-staff-and-volunteer-polo-confirmation/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://advanced.jhu.edu/sitemap_index.xml
sitemap https://advanced.jhu.edu/academics/sitemap_index.xml

Comments

  • www.robotstxt.org/