executive.mit.edu
robots.txt
Robots Exclusion Standard data for executive.mit.edu
Resource Scan
Scan Details
| Site Domain | executive.mit.edu |
| Base Domain | mit.edu |
| Scan Status | Ok |
| Last Scan | 2025-08-31T11:06:44+00:00 |
| Next Scan | 2025-09-30T11:06:44+00:00 |
Last Scan
| Scanned | 2025-08-31T11:06:44+00:00 |
| URL | https://executive.mit.edu/robots.txt |
| Domain IPs | 104.16.70.81, 104.18.230.100 |
| Response IP | 104.18.230.100 |
| Found | Yes |
| Hash | 876556ff5af8a09a0074675041bb015d745f06258520e2a0162ded80103f3d5f |
| SimHash | 0221464de190 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /session/* |
| Disallow | /_debug/ |
| Disallow | /_plugins/ |
| Disallow | /ajax/ |
| Disallow | /cms/ |
| Disallow | *%26utm_source |
| Disallow | *?utm_source |
| Disallow | *%26utm_campaign |
| Disallow | *?utm_campaign |
| Disallow | *%26utm_medium |
| Disallow | *?utm_medium |
| Disallow | *%26utm_content |
| Disallow | *?utm_content |
| Disallow | *%26cmpid |
| Disallow | *?cmpid |
| Disallow | *%26sortBy |
| Disallow | *?sfVideo |
| Disallow | *%26sfVideo |
| Disallow | *?tab |
| Disallow | *%26tag |
| Disallow | *?tag |
| Disallow | *?p= |
| Disallow | *?q= |
| Disallow | *?public |
| Disallow | *?fld |
| Disallow | *%26year |
| Disallow | *%26month |
| Disallow | *?redirectUrl |
| Disallow | */null |
| Disallow | /*-brochure |
| Disallow | /mysloan/ |
| Disallow | *?id= |
| Disallow | *?gclid= |
| Disallow | *?cid= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://executive.mit.edu/sitemap_index.xml |