travelers.com
robots.txt
Robots Exclusion Standard data for travelers.com
Resource Scan
Scan Details
| Site Domain | travelers.com |
| Base Domain | travelers.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T23:41:40+00:00 |
| Next Scan | 2024-11-28T23:41:40+00:00 |
Last Scan
| Scanned | 2024-10-29T23:41:40+00:00 |
| URL | https://travelers.com/robots.txt |
| Redirect | https://www.travelers.com/robots.txt |
| Redirect Domain | www.travelers.com |
| Redirect Base | travelers.com |
| Domain IPs | 170.202.248.56 |
| Redirect IPs | 23.203.76.216 |
| Response IP | 23.203.76.216 |
| Found | Yes |
| Hash | 86e834a9408c642add2a5f55a3b52c6ae0c4692f49a8ebcbb36c77db3203c1c7 |
| SimHash | 59416262c186 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /travelerspreview |
| Disallow | /*search* |
| Disallow | /*printerFriendly%3Dtrue |
| Disallow | /claims/vendor-disclaimer-preapp |
| Disallow | /claims/vendor-disclaimer |
| Disallow | /about-travelers/citizen-travelers/citizen-playbook |
| Disallow | /travelers-institute/webinar-series/symposia-series/2024-economic-outlook |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.travelers.com/sitemap.xml |
Comments