mc.edu
robots.txt
Robots Exclusion Standard data for mc.edu
Resource Scan
Scan Details
| Site Domain | mc.edu |
| Base Domain | mc.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-01T09:50:58+00:00 |
| Next Scan | 2024-10-31T09:50:58+00:00 |
Last Scan
| Scanned | 2024-10-01T09:50:58+00:00 |
| URL | https://mc.edu/robots.txt |
| Redirect | https://www.mc.edu/robots.txt |
| Redirect Domain | www.mc.edu |
| Redirect Base | mc.edu |
| Domain IPs | 104.247.79.10 |
| Redirect IPs | 104.247.79.10 |
| Response IP | 104.247.79.10 |
| Found | Yes |
| Hash | 6a56f0628c152e46e55533ae64da27585768de65cede9b73e3bcd1fe2133decf |
| SimHash | e1545f516d3b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /concrete-core |
| Disallow | /config |
| Disallow | /controllers |
| Disallow | /files |
| Disallow | /jobs |
| Disallow | /single_pages |
| Disallow | /faculty-staff |
| Disallow | /sacs |
| Disallow | /qep |
| Disallow | /archive |
| Disallow | /mcmoodle |
| Disallow | /l/* |
| Allow | /concrete/js |
| Allow | /concrete/css |
| Disallow | /blocks/*.php$ |
| Disallow | /blocks/*.xml$ |
| Disallow | /concrete/*.php$ |
| Disallow | /concrete/*.xml$ |
| Disallow | /packages/*.php$ |
| Disallow | /packages/*.xml$ |
| Disallow | /updates/*.php$ |
| Disallow | /updates/*.xml$ |
| Disallow | /offices/marketing/application/files/7816/6066/5879/logo-clippedat2x.png |
| Disallow | /offices/marketing/application/files/9116/6066/5880/logo-wrong-colorat2x.png |
| Disallow | /offices/marketing/application/files/4416/6066/5880/logo-filterat2x.png |
| Disallow | /offices/marketing/application/files/4216/6066/5880/logo-distortedat2x.png |
| Disallow | /offices/marketing/application/files/2516/6066/5880/logo-wrong-fontat2x.png |
| Disallow | /offices/marketing/application/files/1216/6066/5879/logo-busyat2x.png |
| Disallow | /offices/marketing/application/files/3816/6066/5880/logo-dark-photoat2x.png |
| Disallow | /offices/marketing/application/files/3316/6066/5880/logo-patternat2x.png |
| Disallow | /offices/marketing/application/files/9116/6083/6622/logo-wrong-relationshipat2x.png |
| Disallow | /offices/marketing/application/files/4416/6083/6622/logo-fillat2x.png |
| Disallow | /offices/marketing/application/files/4016/6083/6622/logo-outlineat2x.png |
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) image size by siteimprove.com
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mc.edu/sitemap.xml |
Comments