johnson.cornell.edu
robots.txt
Robots Exclusion Standard data for johnson.cornell.edu
Resource Scan
Scan Details
| Site Domain | johnson.cornell.edu |
| Base Domain | cornell.edu |
| Scan Status | Ok |
| Last Scan | 4/11/2025, 12:30:27 AM |
| Next Scan | 5/11/2025, 12:30:27 AM |
Last Scan
| Scanned | 4/11/2025, 12:30:27 AM |
| URL | https://johnson.cornell.edu/robots.txt |
| Redirect | https://www.johnson.cornell.edu/robots.txt |
| Redirect Domain | www.johnson.cornell.edu |
| Redirect Base | cornell.edu |
| Domain IPs | 75.2.65.169, 99.83.129.68 |
| Redirect IPs | 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3 |
| Response IP | 23.185.0.3 |
| Found | Yes |
| Hash | 726ca18849fc28fee3ca23bdb9c2a056fd79b74c959c737c1cfc59c838fae96f |
| SimHash | 6b0c5d87c3d1 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /*?eventDisplay= | https://www.johnson.cornell.edu/?eventDate=2021-11&eventDisplay=month&paged=2&post_type=tribe_events |
| Disallow | /*?ical | https://www.johnson.cornell.edu/event/mps-in-management-accounting-specialization-information-session-8/?ical=1 |
| Disallow | /*eventDate%3D | https://www.johnson.cornell.edu/?eventDate=2021-11&eventDisplay=month&paged=2&post_type=tribe_events |
| Disallow | /*?tribe-bar-date= | https://www.johnson.cornell.edu/events/category/full-time-mba-admissions-office-hours/list/?eventDisplay=past&ical=1&tribe-bar-date=2021-09-02 |
| Disallow | /events/month/* | https://www.johnson.cornell.edu/events/month/2021-11/ |
| Disallow | /events/week/* | https://www.johnson.cornell.edu/events/week/2021-09-06/ |
| Disallow | /events/category/* | https://www.johnson.cornell.edu/events/category/full-time-mba-admissions-office-hours/list/ |
| Disallow | /events/20* | https://www.johnson.cornell.edu/events/2021-09-01/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.johnson.cornell.edu/sitemap_index.xml |