ivansinsurance.com
robots.txt
Robots Exclusion Standard data for ivansinsurance.com
Resource Scan
Scan Details
| Site Domain | ivansinsurance.com |
| Base Domain | ivansinsurance.com |
| Scan Status | Ok |
| Last Scan | 2025-05-22T16:32:22+00:00 |
| Next Scan | 2025-06-21T16:32:22+00:00 |
Last Scan
| Scanned | 2025-05-22T16:32:22+00:00 |
| URL | https://www.ivansinsurance.com/robots.txt |
| Domain IPs | 104.18.42.132, 172.64.145.124, 2606:4700:4400::6812:2a84, 2606:4700:4400::ac40:917c |
| Response IP | 104.18.42.132 |
| Found | Yes |
| Hash | 7eee1cd9b67f05e1648eeeaddf9c5da1ff2900b0e46e96f6a4bb1e9b18405587 |
| SimHash | 2945db528313 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /archive |
| Disallow | /audit-sitemap |
| Disallow | /link |
| Disallow | /website-archive |
| Disallow | /*.gif$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ivans.com/sitemap/ |