carfax.com
robots.txt
Robots Exclusion Standard data for carfax.com
Resource Scan
Scan Details
| Site Domain | carfax.com |
| Base Domain | carfax.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T02:35:44+00:00 |
| Next Scan | 2024-11-17T02:35:44+00:00 |
Last Scan
| Scanned | 2024-11-10T02:35:44+00:00 |
| URL | https://www.carfax.com/robots.txt |
| Domain IPs | 52.84.150.36, 52.84.150.40, 52.84.150.41, 52.84.150.50 |
| Response IP | 52.84.150.41 |
| Found | Yes |
| Hash | 40bdecaf88e7700675a2e8766ce5e77ded659ee5782c93ab01552afb32cf8863 |
| SimHash | 00d232e1490d |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /vrpassets/data | vrs |
| Disallow | /vehicle/ | - |
| Disallow | /*partner%3D | - |
| Disallow | /*partnerCode | - |
| Disallow | /*compcode%3D | - |
| Disallow | /*vin%3D | - |
| Disallow | /*VIN%3D | - |
| Disallow | /*report%3D | - |
| Disallow | /*source%3D | - |
| Disallow | /*cmp%3D | - |
| Disallow | /*email%3D | - |
| Disallow | /*?_branch_view_id= | - |
| Disallow | /bbg/ | - |
| Disallow | /pdf/ | - |
| Disallow | /contact/ | - |
| Disallow | /manifest/ | - |
| Disallow | /warranty/ | - |
| Disallow | /DP_Rpt_links/ | - |
| Disallow | /DP_Rpt_Links/ | - |
| Disallow | /MbgRefund/ | - |
| Disallow | /phoenix/ | - |
| Disallow | /myid/ | - |
| Disallow | /car-dealer/api | - |
| Disallow | /Definitions/ | - |
| Disallow | /dealers/ | - |
| Disallow | /dealerinventory/ | - |
| Disallow | /api/ | - |
| Disallow | /consumer-api-gateway/ | - |
| Disallow | /icr-form/ | - |
| Disallow | /cfm/ | - |
| Disallow | /VehicleHistory/ | - |
| Disallow | /rate-car/?* | - |
| Disallow | /auto-repair-shops/ | - |
| Disallow | /signin* | sign in for mycarfax |
| Disallow | /signup* | sign up for mycarfax |
| Disallow | /forgot-password* | for mycarfax |
| Disallow | /?wordfence* | - |
| Disallow | /directions/ | - |
| Disallow | /viewCustomerReport.do?* | - |
| Disallow | /knowledge/ | - |
| Disallow | /sortOrder/ | - |
| Disallow | /vrs | - |
| Disallow | /arsapi/ | - |
| Disallow | /sign-up/ | - |
| Disallow | /fsb/ | - |
| Disallow | /viewEmailReport.do* | - |