northwestern.edu
robots.txt
Robots Exclusion Standard data for northwestern.edu
Resource Scan
Scan Details
| Site Domain | northwestern.edu |
| Base Domain | northwestern.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-18T21:46:59+00:00 |
| Next Scan | 2024-11-17T21:46:59+00:00 |
Last Scan
| Scanned | 2024-10-18T21:46:59+00:00 |
| URL | https://northwestern.edu/robots.txt |
| Redirect | https://www.northwestern.edu/robots.txt |
| Redirect Domain | www.northwestern.edu |
| Redirect Base | northwestern.edu |
| Domain IPs | 129.105.136.48 |
| Redirect IPs | 129.105.136.48 |
| Response IP | 129.105.136.48 |
| Found | Yes |
| Hash | f41a422bd937982f6fc3a25d955e3f8945a5baf8c2bf3f667ea0e0ee36103c6e |
| SimHash | 641d927896d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /.TRASH/ |
| Disallow | /.old-it-pages/ |
| Disallow | /.old/ |
| Disallow | /101/ |
| Disallow | /account-management-devel/ |
| Disallow | /activities/ |
| Disallow | /admin/ |
| Disallow | /amstp/ |
| Disallow | /ar/ |
| Disallow | /buehler/ |
| Disallow | /cgi-bin/ |
| Disallow | /chicagocampusmaps/ |
| Disallow | /cms/ |
| Disallow | /common/ |
| Disallow | /compute/ |
| Disallow | /course-viewer/ |
| Disallow | /demo-department/ |
| Disallow | /docs/ |
| Disallow | /dwhouse/ |
| Disallow | /family-institute/ |
| Disallow | /fieldstudies/ |
| Disallow | /graduate-fellowships/ |
| Disallow | /helpdesk/.work/ |
| Disallow | /helpdesk/network/ |
| Disallow | /helpdesk/pre/ |
| Disallow | /icair/.old/ |
| Disallow | /it-menu-proto/ |
| Disallow | /it-menu/ |
| Disallow | /it-virtual/.archive/ |
| Disallow | /it/guidelines/old/1997-04/ |
| Disallow | /it/guidelines/old/1998-01/ |
| Disallow | /it/guidelines/old/1998-04/ |
| Disallow | /it/guidelines/old/ |
| Disallow | /it/guidelines/proto/ |
| Disallow | /it/icair_new/ |
| Disallow | /it/ms/ |
| Disallow | /itg/ |
| Disallow | /need-it/ |
| Disallow | /newsfeed/ |
| Disallow | /nmc/ |
| Disallow | /not-in-production/ |
| Disallow | /nu150/book/.old/ |
| Disallow | /nu150/postcards/images/ |
| Disallow | /nu150/postcards/ssi/ |
| Disallow | /nuilr/ |
| Disallow | /nuinfo-proto12/www-v8/emergency/ssi/ |
| Disallow | /nuinfotest/ |
| Disallow | /nuportalbreakingnews/ |
| Disallow | /registrar/cgi-bin/ |
| Disallow | /resnet/ |
| Disallow | /search-help/ |
| Disallow | /sed/ |
| Disallow | /service/ |
| Disallow | /sheil/ |
| Disallow | /stomatology/ |
| Disallow | /student/old/ |
| Disallow | /summersa/ |
| Disallow | /test/ |
| Disallow | /traffic/ |
| Disallow | /tss-virtual/.work/ |
| Disallow | /tss-virtual/pre/ |
| Disallow | /tss/siguccs/1996/abstracts/ |
| Disallow | /tss/siguccs/ |
| Disallow | /tss/troubleshoot/obsolete/ |
| Disallow | /undergrad-finaid/ |
| Disallow | /univ-relations/webproto/med-design/ |
| Disallow | /univ-relations/webproto/ |
| Disallow | /ur-staff-proto/ |
| Disallow | /vp-research-gradstudies/ |
| Disallow | /webservices/.test/ |
| Disallow | /webservices/resources/forms/ |
| Disallow | /webservices/ |
| Disallow | /webtech/ |
| Disallow | /world/admin/ |
| Disallow | /world/interesting/atl-interest/admin/ |
| Disallow | /world/ |
| Disallow | /wrestling/ |
| Disallow | /www-v5/emergency/alert/ |
| Disallow | /www-v5/emergency/ssi/ |
| Disallow | /www-v6/emergency/ssi/ |
| Disallow | /www-v8/emergency/ssi/ |
| Disallow | /xscs/ |
| Disallow | /it-test-2016/ |
| Disallow | /nuinfo-proto9-old/ |
Comments