www.fsi.illinois.edu
robots.txt
Robots Exclusion Standard data for www.fsi.illinois.edu
Resource Scan
Scan Details
Site Domain | www.fsi.illinois.edu |
Base Domain | illinois.edu |
Scan Status | Ok |
Last Scan | 2024-08-28T19:28:04+00:00 |
Next Scan | 2024-09-27T19:28:04+00:00 |
Last Scan
Scanned | 2024-08-28T19:28:04+00:00 |
URL | https://www.fsi.illinois.edu/robots.txt |
Domain IPs | 128.174.94.220 |
Response IP | 128.174.94.220 |
Found | Yes |
Hash | aab715401c6942f0baa862b39a02a8951041008c65a178212d7ec91585a54cb3 |
SimHash | d07c5d6c3d4e |
Groups
bingbot
googlebot
Rule | Path |
---|---|
Disallow | /.well_known |
Disallow | /_mmServerScripts |
Disallow | /appData |
Disallow | /apply |
Disallow | /browser |
Disallow | /codechallenge |
Disallow | /css |
Disallow | /data |
Disallow | /demo |
Disallow | /files |
Disallow | /fsiapi |
Disallow | /iema |
Disallow | /includes |
Disallow | /maintenance |
Disallow | /online |
Disallow | /online_old |
Disallow | /projects |
Disallow | /resource_center |
Disallow | /scripts |
Disallow | /sparkey_reports |
Disallow | /temp |
Disallow | /tempSigs |
Disallow | /tools |
Disallow | /content/1A_old_remove |
Disallow | /content/library/search |
Disallow | /content/courses/schedule |
Disallow | /documents/forms/Old |
Warnings
- 3 invalid lines.