law.northwestern.edu
robots.txt

Robots Exclusion Standard data for law.northwestern.edu

Resource Scan

Scan Details

Site Domain law.northwestern.edu
Base Domain northwestern.edu
Scan Status Ok
Last Scan2025-05-09T01:07:57+00:00
Next Scan 2025-06-08T01:07:57+00:00

Last Scan

Scanned2025-05-09T01:07:57+00:00
URL http://law.northwestern.edu/robots.txt
Redirect https://wwws.law.northwestern.edu/robots.txt
Redirect Domain wwws.law.northwestern.edu
Redirect Base northwestern.edu
Domain IPs 129.105.119.221, 129.105.202.205, 165.124.224.205, 165.124.224.215
Redirect IPs 129.105.119.221
Response IP 129.105.119.221
Found Yes
Hash b129d6d80ccf14c364ac62033c4b0652d6e2b50a8edf3b7678ceb649a5efd785
SimHash 886a6ca3eb6a

Groups

*

Rule Path
Disallow /test/
Disallow /cfide
Disallow /utilities
Disallow httpd.ini
Disallow /scripts
Disallow /graphics
Disallow /aspnet_client
Disallow /CFFormGateway
Disallow /lawlibrary
Disallow /admissions/newstudent/
Disallow /newstudent/
Disallow /ard/profiles/
Disallow /css/test/app.cfm
Disallow /tracking/

stress-agent

Rule Path
Disallow /