rochester.edu
robots.txt
Robots Exclusion Standard data for rochester.edu
Resource Scan
Scan Details
| Site Domain | rochester.edu |
| Base Domain | rochester.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-31T09:15:23+00:00 |
| Next Scan | 2024-11-30T09:15:23+00:00 |
Last Scan
| Scanned | 2024-10-31T09:15:23+00:00 |
| URL | https://rochester.edu/robots.txt |
| Redirect | https://www.rochester.edu/robots.txt |
| Redirect Domain | www.rochester.edu |
| Redirect Base | rochester.edu |
| Domain IPs | 128.151.77.39 |
| Redirect IPs | 128.151.77.39 |
| Response IP | 128.151.77.39 |
| Found | Yes |
| Hash | c58a3f5a9ddb37f7836496bbd1ac4be6ea5507b2347054eb2bb19d57a8a523fc |
| SimHash | f03e7c6db141 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /adv/advancement/ |
| Disallow | /report/ |
| Disallow | /ITS/reports/ |
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /ITS/web/group/dev/ |
| Disallow | /calendar/ |
| Disallow | /calendar/upload.php |
| Disallow | /calendar/epicker.php |
| Disallow | /beta/ |
| Disallow | /ur-cgi-bin/ |
| Disallow | /its/dcs/forms/ |
| Disallow | /ITS/dcs/forms/ |
| Disallow | /college/CCAS/clusters/cluster_search7.html |
| Disallow | /college/ccas/clusters/cluster_search7.html |
| Disallow | /its/acs/oge_verifies_form.html |
| Disallow | /college/alumni/reunion2011/classes/ |
| Disallow | /giving/gec/roll |
| Disallow | /giving/gec/roll2 |
| Disallow | /college/alumni/reunion/classes/ |
| Disallow | /2013/donors |
| Disallow | /%40rochester/archive/issue.php?iss=2701 |
| Disallow | /currents/V41/N02/Sloan.html |
| Disallow | /college/ugresearch/ur-upp/ |
| Disallow | /poc-tech/ |
| Disallow | /working/hr/jobs/feeds/ |
| Disallow | /wp-admin/ |
| Disallow | /policies/all/ |