hult.edu
robots.txt
Robots Exclusion Standard data for hult.edu
Resource Scan
Scan Details
| Site Domain | hult.edu |
| Base Domain | hult.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-10T06:33:08+00:00 |
| Next Scan | 2024-06-09T06:33:08+00:00 |
Last Scan
| Scanned | 2024-05-10T06:33:08+00:00 |
| URL | https://hult.edu/robots.txt |
| Redirect | https://www.hult.edu/robots.txt |
| Redirect Domain | www.hult.edu |
| Redirect Base | hult.edu |
| Domain IPs | 3.229.225.193, 35.175.19.221 |
| Redirect IPs | 13.35.18.100, 13.35.18.111, 13.35.18.76, 13.35.18.93, 2600:9000:2135:3c00:6:fc2c:1180:93a1, 2600:9000:2135:3e00:6:fc2c:1180:93a1, 2600:9000:2135:400:6:fc2c:1180:93a1, 2600:9000:2135:6600:6:fc2c:1180:93a1, 2600:9000:2135:6800:6:fc2c:1180:93a1, 2600:9000:2135:7600:6:fc2c:1180:93a1, 2600:9000:2135:a600:6:fc2c:1180:93a1, 2600:9000:2135:d600:6:fc2c:1180:93a1 |
| Response IP | 13.35.18.76 |
| Found | Yes |
| Hash | 69b92775ecda5461e85099760ee8d8a714d69fe78b47c2a31e7c0a95a3746afc |
| SimHash | 5f0468074391 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /blog/*/feed/atom/ |
| Disallow | /editor |
| Disallow | /fscallback |
| Disallow | /templates/ |
| Disallow | /landing/ |
| Disallow | /lp/ |
| Disallow | /en/executive-education/forms/ |
| Disallow | /config/ |
| Disallow | /blog/feed/ |
| Disallow | /blog/?s= |
| Disallow | /blog/search/* |
| Disallow | /en/executive-education/forms/ |
| Disallow | /landing/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hult.edu/sitemap/sitemap-index.xml |
| sitemap | https://www.hult.edu/blog/sitemap_index.xml |
| sitemap | https://www.hult.edu/blog/feed/atom/ |
Warnings
- `host` is not a known field.