compare4benefit.com
robots.txt
Robots Exclusion Standard data for compare4benefit.com
Resource Scan
Scan Details
| Site Domain | compare4benefit.com |
| Base Domain | compare4benefit.com |
| Scan Status | Ok |
| Last Scan | 2025-05-16T18:02:50+00:00 |
| Next Scan | 2025-06-15T18:02:50+00:00 |
Last Scan
| Scanned | 2025-05-16T18:02:50+00:00 |
| URL | https://compare4benefit.com/robots.txt |
| Redirect | https://www.compare4benefit.com/robots.txt |
| Redirect Domain | www.compare4benefit.com |
| Redirect Base | compare4benefit.com |
| Domain IPs | 2a02:4780:15:d90b:3586:91a:10db:708c, 84.32.84.149 |
| Redirect IPs | 2a02:4780:16:d5fd:a015:9f63:73d:52d9, 84.32.84.210 |
| Response IP | 77.37.115.151 |
| Found | Yes |
| Hash | 8e5c7981fb3bab0ca8bbeca5e5b045c57ca012f8cb0ed8008edfb8d6a906d33c |
| SimHash | 6d054f24ce90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /login |
| Disallow | /forgot |
| Disallow | /admin |
| Disallow | /carinsurance/vehicle |
| Disallow | /carinsurance/driver |
| Disallow | /travelinsurance |
| Disallow | /healthinsurance |
| Disallow | /propertyinsurance |
| Disallow | /admin/ |
| Disallow | /cgi-bin/ |
| Disallow | /scripts/ |
| Disallow | /tmp/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.compare4benefit.com/sitemap.xml |