static.carfax.com
robots.txt
Robots Exclusion Standard data for static.carfax.com
Resource Scan
Scan Details
| Site Domain | static.carfax.com |
| Base Domain | carfax.com |
| Scan Status | Ok |
| Last Scan | 2024-05-22T09:56:51+00:00 |
| Next Scan | 2024-06-05T09:56:51+00:00 |
Last Scan
| Scanned | 2024-05-22T09:56:51+00:00 |
| URL | https://static.carfax.com/robots.txt |
| Domain IPs | 13.226.2.21, 13.226.2.23, 13.226.2.67, 13.226.2.74 |
| Response IP | 108.157.52.122 |
| Found | Yes |
| Hash | f935a0a5413c997b0079978edf410f61297ce49c61d81c4ac70e2d679b0ceb32 |
| SimHash | 29b002314f3f |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | /phoenix/glossary.cfx | - |
| Allow | */Maple | - |
| Disallow | /my-searches | SAVE CAR feature |
| Disallow | /*partner%3D | - |
| Disallow | /*partnerCode | - |
| Disallow | /*cmp%3D | - |
| Disallow | /*email%3D | - |
| Disallow | /bbg/ | - |
| Disallow | /pdf/ | - |
| Disallow | /contact/ | - |
| Disallow | /manifest/ | - |
| Disallow | /warranty/ | - |
| Disallow | /DP_Rpt_links/ | - |
| Disallow | /DP_Rpt_Links/ | - |
| Disallow | /MbgRefund/ | - |
| Disallow | /phoenix/ | - |
| Disallow | /myid/ | - |
| Disallow | /car-dealer/api | - |
| Disallow | /Definitions/ | - |
| Disallow | /*vdp | - |
| Disallow | /search* | start ucl |
| Disallow | /dealers/ | - |
| Disallow | /dealerinventory/ | - |
| Disallow | /api/ | - |
| Disallow | /icr-form/ | - |
| Disallow | /auto-repair-shops/ | - |
| Disallow | */Map | map on dealer inventory pages |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.carfax.com/sitemap_index.xml |
Warnings
- 1 invalid line.