media.carfax.com
robots.txt
Robots Exclusion Standard data for media.carfax.com
Resource Scan
Scan Details
| Site Domain | media.carfax.com |
| Base Domain | carfax.com |
| Scan Status | Ok |
| Last Scan | 2024-06-16T22:38:10+00:00 |
| Next Scan | 2024-07-16T22:38:10+00:00 |
Last Scan
| Scanned | 2024-06-16T22:38:10+00:00 |
| URL | https://media.carfax.com/robots.txt |
| Redirect | https://static.carfax.com/mcs/robots.txt |
| Redirect Domain | static.carfax.com |
| Redirect Base | carfax.com |
| Domain IPs | 18.217.54.143, 3.128.250.250, 3.134.134.44 |
| Redirect IPs | 13.226.2.21, 13.226.2.23, 13.226.2.67, 13.226.2.74 |
| Response IP | 18.165.171.121 |
| Found | Yes |
| Hash | e0dcd9e0c5305bb4005ea472848e5f3ec9a1ce4c7e53b39be8c517cf3ae22b7a |
| SimHash | 00d272c16d1c |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*partner%3D | - |
| Disallow | /*partnerCode | - |
| Disallow | /*compcode%3D | - |
| Disallow | /*vin%3D | - |
| Disallow | /*VIN%3D | - |
| Disallow | /*report%3D | - |
| Disallow | /*source%3D | - |
| Disallow | /*cmp%3D | - |
| Disallow | /*email%3D | - |
| Disallow | /*?_branch_view_id= | - |
| Disallow | /bbg/ | - |
| Disallow | /pdf/ | - |
| Disallow | /contact/ | - |
| Disallow | /manifest/ | - |
| Disallow | /warranty/ | - |
| Disallow | /DP_Rpt_links/ | - |
| Disallow | /DP_Rpt_Links/ | - |
| Disallow | /MbgRefund/ | - |
| Disallow | /phoenix/ | - |
| Disallow | /myid/ | - |
| Disallow | /car-dealer/api | - |
| Disallow | /Definitions/ | - |
| Disallow | /dealers/ | - |
| Disallow | /dealerinventory/ | - |
| Disallow | /api/ | - |
| Disallow | /consumer-api-gateway/ | - |
| Disallow | /icr-form/ | - |
| Disallow | /cfm/ | - |
| Disallow | /VehicleHistory/ | - |
| Disallow | /rate-car/?* | - |
| Disallow | /auto-repair-shops/ | - |
| Disallow | /signin* | sign in for mycarfax |
| Disallow | /signup* | sign up for mycarfax |
| Disallow | /forgot-password* | for mycarfax |
| Disallow | /?wordfence* | - |
| Disallow | /directions/ | - |
| Disallow | /viewCustomerReport.do?* | - |
| Disallow | /knowledge/ | - |
| Disallow | /sortOrder/ | - |
| Disallow | /vrs | - |
| Disallow | /arsapi/ | - |
| Disallow | /sign-up/ | - |
| Disallow | /fsb/ | - |
| Disallow | /viewEmailReport.do* | - |