comparison411.com
robots.txt
Robots Exclusion Standard data for comparison411.com
Resource Scan
Scan Details
| Site Domain | comparison411.com |
| Base Domain | comparison411.com |
| Scan Status | Ok |
| Last Scan | 2024-05-29T15:27:07+00:00 |
| Next Scan | 2024-06-05T15:27:07+00:00 |
Last Scan
| Scanned | 2024-05-29T15:27:07+00:00 |
| URL | https://comparison411.com/robots.txt |
| Redirect | https://www.comparison411.com/robots.txt |
| Redirect Domain | www.comparison411.com |
| Redirect Base | comparison411.com |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.123, 76.76.21.22 |
| Response IP | 76.76.21.93 |
| Found | Yes |
| Hash | 90ecd27061a210f1a81c28efc0e050bd29c0e2bf164a4d9164e4980ddba8fe8f |
| SimHash | 016591114531 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /terms-of-use |
| Disallow | /redirect |
| Disallow | /privacy-policy |
| Disallow | /partner |
| Disallow | /optout |
| Disallow | /contact-us |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /fo-verify |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.comparison411.com/sitemap.xml |