static.carfax.com
robots.txt
Robots Exclusion Standard data for static.carfax.com
Resource Scan
Scan Details
Site Domain | static.carfax.com |
Base Domain | carfax.com |
Scan Status | Ok |
Last Scan | 2024-05-08T08:23:02+00:00 |
Next Scan | 2024-05-22T08:23:02+00:00 |
Last Scan
Scanned | 2024-05-08T08:23:02+00:00 |
URL | https://static.carfax.com/robots.txt |
Domain IPs | 13.226.210.12, 13.226.210.47, 13.226.210.60, 13.226.210.76 |
Response IP | 18.165.171.121 |
Found | Yes |
Hash | f935a0a5413c997b0079978edf410f61297ce49c61d81c4ac70e2d679b0ceb32 |
SimHash | 29b002314f3f |
Groups
*
Rule | Path | Comment |
---|---|---|
Allow | /phoenix/glossary.cfx | - |
Allow | */Maple | - |
Disallow | /my-searches | SAVE CAR feature |
Disallow | /*partner%3D | - |
Disallow | /*partnerCode | - |
Disallow | /*cmp%3D | - |
Disallow | /*email%3D | - |
Disallow | /bbg/ | - |
Disallow | /pdf/ | - |
Disallow | /contact/ | - |
Disallow | /manifest/ | - |
Disallow | /warranty/ | - |
Disallow | /DP_Rpt_links/ | - |
Disallow | /DP_Rpt_Links/ | - |
Disallow | /MbgRefund/ | - |
Disallow | /phoenix/ | - |
Disallow | /myid/ | - |
Disallow | /car-dealer/api | - |
Disallow | /Definitions/ | - |
Disallow | /*vdp | - |
Disallow | /search* | start ucl |
Disallow | /dealers/ | - |
Disallow | /dealerinventory/ | - |
Disallow | /api/ | - |
Disallow | /icr-form/ | - |
Disallow | /auto-repair-shops/ | - |
Disallow | */Map | map on dealer inventory pages |
Other Records
Field | Value |
---|---|
sitemap | https://www.carfax.com/sitemap_index.xml |
Warnings
- 1 invalid line.