aon.com
robots.txt
Robots Exclusion Standard data for aon.com
Resource Scan
Scan Details
| Site Domain | aon.com |
| Base Domain | aon.com |
| Scan Status | Ok |
| Last Scan | 2024-11-07T11:31:45+00:00 |
| Next Scan | 2024-11-21T11:31:45+00:00 |
Last Scan
| Scanned | 2024-11-07T11:31:45+00:00 |
| URL | https://aon.com/robots.txt |
| Redirect | https://www.aon.com/robots.txt |
| Redirect Domain | www.aon.com |
| Redirect Base | aon.com |
| Domain IPs | 165.125.80.231 |
| Redirect IPs | 104.18.38.31, 172.64.149.225, 2606:4700:4400::6812:261f, 2606:4700:4400::ac40:95e1 |
| Response IP | 104.18.38.31 |
| Found | Yes |
| Hash | 5edbfe0ba5ae5340c62dcbd5cae242455cfedcf79e90da11a1a32c5a34455cf8 |
| SimHash | ad0958842190 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bursts/ |
| Disallow | /surveys/ |
| Disallow | /pages/ |
| Disallow | |
| Disallow | /attachements/ |
| Disallow | /attachments/* |
| Disallow | /*.pdf$ |
| Disallow | /mypreferences-staging/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aon.com/sitemap-master.xml |