sps.northwestern.edu
robots.txt
Robots Exclusion Standard data for sps.northwestern.edu
Resource Scan
Scan Details
| Site Domain | sps.northwestern.edu |
| Base Domain | northwestern.edu |
| Scan Status | Ok |
| Last Scan | 2024-11-11T23:27:31+00:00 |
| Next Scan | 2024-11-25T23:27:31+00:00 |
Last Scan
| Scanned | 2024-11-11T23:27:31+00:00 |
| URL | https://sps.northwestern.edu/robots.txt |
| Domain IPs | 129.105.119.220 |
| Response IP | 129.105.119.220 |
| Found | Yes |
| Hash | f8565067ed1d6886e89b8cec68c84137f5f87999802cf8a5cc8751053c1e8c4a |
| SimHash | a90199236672 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /info/ |
| Disallow | /information/ |
| Disallow | /summer/planning-guide/ |
| Disallow | /calendar/_files/ |
| Disallow | /calendar/include/ |
| Disallow | /cms/index.php/ |
| Disallow | /data-science-programme/ |
| Disallow | /data-science-programme/index.php |
| Disallow | /web/index.php/ |
| Disallow | /include/js/ |
| Disallow | /college-preparation/accepted-students/ |
| Disallow | /main/staff/ |
| Disallow | /masters/global-health/visitor_form/ |
| Disallow | /masters/information-systems/visitor_form/ |
| Disallow | /masters/predictive-analytics/ |
| Disallow | /masters/predictive-analytics/admission.php |
| Disallow | /part-time-undergraduate/new-online-working-folder/ |
| Disallow | /test-brad/ |
Comments