cstatic-images.com
robots.txt
Robots Exclusion Standard data for cstatic-images.com
Resource Scan
Scan Details
Site Domain | cstatic-images.com |
Base Domain | cstatic-images.com |
Scan Status | Ok |
Last Scan | 2025-08-14T07:48:10+00:00 |
Next Scan | 2025-09-13T07:48:10+00:00 |
Last Scan
Scanned | 2025-08-14T07:48:10+00:00 |
URL | https://www.cstatic-images.com/robots.txt |
Domain IPs | 104.69.157.8 |
Response IP | 104.69.43.53 |
Found | Yes |
Hash | 51a549d6dc2a8495f7f7b55e46508633781864b2cf8fea2bbd6f3808268a7d5e |
SimHash | 1fe2039043d6 |
Groups
*
Rule | Path | Comment |
---|---|---|
Allow | /ads.txt | - |
Disallow | /windshield/ | - |
Disallow | /ajax/coreshoppingsupportapi/1.0/listing/vhr/* | CarFax |
Disallow | /ajax/listingsapi/1.0/saved-vehicles/* | Missing Registration cookie |
Disallow | /document-generator/ | Service Coupons - no longer offered |
Allow | /profile/your-garage/ | - |
Disallow | /profile/ | User profiles |
Disallow | /dv/ | - |
Disallow | /rv/ | - |
Disallow | /react-shop-webapp/ | - |
Disallow | /go/advice/advice_carprices.jhtml | - |
Disallow | /go/buy-cars/* | - |
Disallow | /go/car-dealers/kcj/* | - |
Disallow | /go/dealersearch/logDealerLead* | - |
Disallow | /go/search/newBuyIndex.jsp* | - |
Disallow | /go/search/dealerWebsite.jsp* | - |
Disallow | /go/video/motorweek/videoPopup.jsp* | - |
Disallow | /new-cars/*/ | - |
Disallow | /new-cars/*/*/ | - |
Disallow | /reviews/*/ | - |
Disallow | /shopping/all/* | - |
Disallow | /shopping/certified-preowned/ | - |
Disallow | /shopping/results/ | - |
Disallow | *maximum_distance%3Dall* | - |
Disallow | *ni%3D1* | - |
Disallow | *ni%3D2* | - |
Disallow | *ni%3D3* | - |
Disallow | */vehiclehistory/ | - |
Disallow | /signin/?redirect_path | - |
Disallow | /signup/?redirect_path | - |
Disallow | */special_offers/ | - |
Allow | /sell/how-to/ | - |
Allow | /sell/instant-offer/ | - |
Allow | /sell/verified-checkout/ | - |
Disallow | /sell/*/ | - |
Disallow | /sell-new/ | - |
Disallow | /signin/apple_go/ | - |
Disallow | /signin/google_go/ | - |
Disallow | /signin/fb_go/ | - |
Disallow | /vehicle/ | - |
Disallow | /vehicledetail/ | - |
Disallow | /dealers/*/reviews/*/ | - |
Disallow | /research/*/consumer-reviews/*/ | - |
Disallow | */write-review/ | - |
Disallow | */write-a-review/ | - |
Disallow | */?reviewTags* | - |
Disallow | */dealer_reviews/write-a-review/ | - |
Disallow | /dealers/*claim/ | - |
Disallow | *award_link* | - |
Disallow | *sort_by* | - |
Disallow | *page_size* | - |
Disallow | *ev_report_url* | - |
Disallow | */employees/ | - |
Disallow | *href_to_vdp* | - |
Other Records
Field | Value |
---|---|
sitemap | https://www.cars.com/secure/sitemap/s_sitemap_index.xml |
sitemap | https://www.cars.com/news/sitemap/index.xml |
sitemap | https://www.cars.com/research/sitemap/research_index.xml |
Comments