fsi.illinois.edu
robots.txt
Robots Exclusion Standard data for fsi.illinois.edu
Resource Scan
Scan Details
| Site Domain | fsi.illinois.edu |
| Base Domain | illinois.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-30T19:20:49+00:00 |
| Next Scan | 2024-06-29T19:20:49+00:00 |
Last Scan
| Scanned | 2024-05-30T19:20:49+00:00 |
| URL | https://fsi.illinois.edu/robots.txt |
| Redirect | https://www.fsi.illinois.edu/robots.txt |
| Redirect Domain | www.fsi.illinois.edu |
| Redirect Base | illinois.edu |
| Domain IPs | 128.174.94.220 |
| Redirect IPs | 128.174.94.220 |
| Response IP | 128.174.94.220 |
| Found | Yes |
| Hash | aab715401c6942f0baa862b39a02a8951041008c65a178212d7ec91585a54cb3 |
| SimHash | d07c5d6c3d4e |
Groups
bingbot
googlebot
| Rule | Path |
|---|---|
| Disallow | /.well_known |
| Disallow | /_mmServerScripts |
| Disallow | /appData |
| Disallow | /apply |
| Disallow | /browser |
| Disallow | /codechallenge |
| Disallow | /css |
| Disallow | /data |
| Disallow | /demo |
| Disallow | /files |
| Disallow | /fsiapi |
| Disallow | /iema |
| Disallow | /includes |
| Disallow | /maintenance |
| Disallow | /online |
| Disallow | /online_old |
| Disallow | /projects |
| Disallow | /resource_center |
| Disallow | /scripts |
| Disallow | /sparkey_reports |
| Disallow | /temp |
| Disallow | /tempSigs |
| Disallow | /tools |
| Disallow | /content/1A_old_remove |
| Disallow | /content/library/search |
| Disallow | /content/courses/schedule |
| Disallow | /documents/forms/Old |
Warnings
- 3 invalid lines.