kelley.iu.edu
robots.txt
Robots Exclusion Standard data for kelley.iu.edu
Resource Scan
Scan Details
| Site Domain | kelley.iu.edu |
| Base Domain | iu.edu |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2025-11-20T13:48:41+00:00 |
| Next Scan | 2026-02-18T13:48:41+00:00 |
Last Successful Scan
| Scanned | 2025-07-01T09:38:21+00:00 |
| URL | https://kelley.iu.edu/robots.txt |
| Domain IPs | 20.121.65.107 |
| Response IP | 20.121.65.107 |
| Found | Yes |
| Hash | 8fa8b1704ea787be76044218730d737e3941e9904e51c8c1e3852529641d0d60 |
| SimHash | 2212487aae82 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.cfm |
| Disallow | /*test |
| Disallow | /_includes/ |
| Disallow | /_php/ |
| Disallow | /_xml/ |
| Disallow | /_shared-sections/ |
| Disallow | /error/ |
| Disallow | /url-list.xml |
| Disallow | /cms/ |
| Disallow | /CMS/ |
| Disallow | /error.txt |
| Disallow | /*machform |
| Disallow | /*experts/profile.html$ |
| Disallow | /*experts/profile.html$ |
| Disallow | /*courses/course.html$ |
| Disallow | /*scholarships/scholarship-details.html$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://kelley.iu.edu/sitemap.xml |