dyson.cornell.edu
robots.txt
Robots Exclusion Standard data for dyson.cornell.edu
Resource Scan
Scan Details
| Site Domain | dyson.cornell.edu |
| Base Domain | cornell.edu |
| Scan Status | Ok |
| Last Scan | 2024-11-18T23:27:00+00:00 |
| Next Scan | 2024-12-18T23:27:00+00:00 |
Last Scan
| Scanned | 2024-11-18T23:27:00+00:00 |
| URL | https://dyson.cornell.edu/robots.txt |
| Domain IPs | 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3 |
| Response IP | 23.185.0.3 |
| Found | Yes |
| Hash | bfbe3af23162d5b11bb592db7e49a9c8cdb9c161ba3f003a80df4d447165a34a |
| SimHash | 6b405616eaf1 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /*?eventDisplay= | https://dyson.cornell.edu/?eventDate=2021-09&eventDisplay=month&paged=2&post_type=tribe_events |
| Disallow | /*?ical | https://dyson.cornell.edu/event/ask-admissions-mps-in-applied-economics-and-management/?ical=1 |
| Disallow | /*eventDate%3D | https://dyson.cornell.edu/?eventDate=2021-09&eventDisplay=month&paged=2&post_type=tribe_events |
| Disallow | /*?tribe-bar-date= | https://dyson.cornell.edu/?eventDate=2021-09&eventDisplay=month&paged=2&post_type=tribe_events |
| Disallow | /events/month/* | https://dyson.cornell.edu/events/month/2021-07/ |
| Disallow | /events/week/* | https://dyson.cornell.edu/events/week/2021-09-14/ |
| Disallow | /events/category/* | https://dyson.cornell.edu/events/category/mps-aem/today/ |
| Disallow | /events/20* | https://dyson.cornell.edu/events/2021-10-27/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dyson.cornell.edu/sitemap_index.xml |