britinsurance.com
robots.txt
Robots Exclusion Standard data for britinsurance.com
Resource Scan
Scan Details
| Site Domain | britinsurance.com |
| Base Domain | britinsurance.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T03:05:46+00:00 |
| Next Scan | 2024-11-24T03:05:46+00:00 |
Last Scan
| Scanned | 2024-11-10T03:05:46+00:00 |
| URL | https://britinsurance.com/robots.txt |
| Redirect | https://www.britinsurance.com/robots.txt |
| Redirect Domain | www.britinsurance.com |
| Redirect Base | britinsurance.com |
| Domain IPs | 162.159.140.127, 172.66.0.125 |
| Redirect IPs | 162.159.140.127, 172.66.0.125, 2606:4700:7::7d, 2a06:98c1:58::7d |
| Response IP | 172.66.0.125 |
| Found | Yes |
| Hash | 105c6cd8471f77cb001445bdf5f142ef7d26f124b6678dcb096dcb97eb7dbc3c |
| SimHash | eb0059404d02 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_Plugins/ |
| Disallow | /bin/ |
| Disallow | /Config/ |
| Disallow | /data/ |
| Disallow | /umbraco/ |
| Disallow | /Views/ |
| Disallow | /global/ |
| Disallow | /site-settings/ |
| Disallow | /industries/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.britinsurance.com/sitemap.xml |