comparecredit.com
robots.txt
Robots Exclusion Standard data for comparecredit.com
Resource Scan
Scan Details
| Site Domain | comparecredit.com |
| Base Domain | comparecredit.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T23:38:48+00:00 |
| Next Scan | 2024-10-21T23:38:48+00:00 |
Last Scan
| Scanned | 2024-09-21T23:38:48+00:00 |
| URL | https://comparecredit.com/robots.txt |
| Redirect | https://www.comparecredit.com/robots.txt |
| Redirect Domain | www.comparecredit.com |
| Redirect Base | comparecredit.com |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.142, 76.76.21.61 |
| Response IP | 76.76.21.98 |
| Found | Yes |
| Hash | 68c26ac51f3ea5e7324b8bc6223bc8ebe8ff7d44eb48bf8f86bf2238748c02f8 |
| SimHash | 235cd2328de3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /404 |
| Disallow | /comparison |
| Disallow | /secure/* |
| Disallow | /international |
| Disallow | static |
| Disallow | page-data |
| Disallow | robots |
| Disallow | sitemap |
| Disallow | %5Bcategory%5D |
| Disallow | %5Bslug%5D |
| Disallow | /testApplyNow |
| Disallow | /under-construction |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.comparecredit.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments