static.carfax.com
robots.txt

Robots Exclusion Standard data for static.carfax.com

Resource Scan

Scan Details

Site Domain static.carfax.com
Base Domain carfax.com
Scan Status Ok
Last Scan2024-05-08T08:23:02+00:00
Next Scan 2024-05-22T08:23:02+00:00

Last Scan

Scanned2024-05-08T08:23:02+00:00
URL https://static.carfax.com/robots.txt
Domain IPs 13.226.210.12, 13.226.210.47, 13.226.210.60, 13.226.210.76
Response IP 18.165.171.121
Found Yes
Hash f935a0a5413c997b0079978edf410f61297ce49c61d81c4ac70e2d679b0ceb32
SimHash 29b002314f3f

Groups

*

Rule Path Comment
Allow /phoenix/glossary.cfx -
Allow */Maple -
Disallow /my-searches SAVE CAR feature
Disallow /*partner%3D -
Disallow /*partnerCode -
Disallow /*cmp%3D -
Disallow /*email%3D -
Disallow /bbg/ -
Disallow /pdf/ -
Disallow /contact/ -
Disallow /manifest/ -
Disallow /warranty/ -
Disallow /DP_Rpt_links/ -
Disallow /DP_Rpt_Links/ -
Disallow /MbgRefund/ -
Disallow /phoenix/ -
Disallow /myid/ -
Disallow /car-dealer/api -
Disallow /Definitions/ -
Disallow /*vdp -
Disallow /search* start ucl
Disallow /dealers/ -
Disallow /dealerinventory/ -
Disallow /api/ -
Disallow /icr-form/ -
Disallow /auto-repair-shops/ -
Disallow */Map map on dealer inventory pages

Other Records

Field Value
sitemap https://www.carfax.com/sitemap_index.xml

Warnings

  • 1 invalid line.