www.exed.hbs.edu
robots.txt
Robots Exclusion Standard data for www.exed.hbs.edu
Resource Scan
Scan Details
| Site Domain | www.exed.hbs.edu |
| Base Domain | hbs.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-30T15:00:18+00:00 |
| Next Scan | 2024-06-29T15:00:18+00:00 |
Last Scan
| Scanned | 2024-05-30T15:00:18+00:00 |
| URL | https://www.exed.hbs.edu/robots.txt |
| Domain IPs | 13.225.4.32, 13.225.4.47, 13.225.4.75, 13.225.4.93 |
| Response IP | 13.225.4.75 |
| Found | Yes |
| Hash | c79416196a9351db736a96fa3245079a1a35514f727ba9746abe01000c61a0ec |
| SimHash | 79029ef747b8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */Documents/* |
| Disallow | */documents/* |
| Disallow | /sys-monitor.aspx |
| Disallow | /self-monitor.aspx |
| Disallow | /blank.aspx |
| Disallow | /templates.aspx |
| Disallow | /router.aspx |
| Disallow | */search.aspx* |
| Disallow | */help.aspx |
| Disallow | */foresee* |
| Disallow | */*-thanks |
| Disallow | */noapply |
| Disallow | |
| Disallow | */*hbr-*.pdf |
| Disallow | */*-brochure.pdf |
| Disallow | */*-curriculum.pdf |
| Disallow | */*-search-data.aspx |
| Disallow | /assets |
| Disallow | /about-us |
| Disallow | /Style%20Library/* |
| Disallow | /_layouts |
| Disallow | /campaign |
| Disallow | /category/Pages |
| Disallow | /redirects |
| Disallow | /updates |
| Disallow | /ReusableContent |
| Allow | /Style%20Library/hbs/js/exed.js |
| Allow | /pf-widget-filters.aspx |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.exed.hbs.edu/sitemap.xml |