cstatic-graphics.com
robots.txt

Robots Exclusion Standard data for cstatic-graphics.com

Resource Scan

Scan Details

Site Domain cstatic-graphics.com
Base Domain cstatic-graphics.com
Scan Status Ok
Last Scan2024-07-01T17:11:10+00:00
Next Scan 2024-07-08T17:11:10+00:00

Last Scan

Scanned2024-07-01T17:11:10+00:00
URL https://www.cstatic-graphics.com/robots.txt
Domain IPs 104.69.157.8
Response IP 104.69.157.8
Found Yes
Hash bcc2ab0797453892e587a205c1bcdd261582ef4febe8471495dd9070b2a3c26d
SimHash 1d40591c2375

Groups

grapeshot

Rule Path
Disallow

powermapper

Rule Path
Allow /

*

Rule Path Comment
Disallow /windshield/ -
Disallow /ajax/coreshoppingsupportapi/1.0/listing/vhr/* CarFax
Disallow /ajax/listingsapi/1.0/saved-vehicles/* Missing Registration cookie
Disallow /profile/ User profiles
Disallow /document-generator/ Service Coupons - no longer offered
Disallow /dv/ -
Disallow /rv/ -
Disallow /react-shop-webapp/ -
Disallow /go/advice/advice_carprices.jhtml -
Disallow /go/buy-cars/* -
Disallow /go/car-dealers/kcj/* -
Disallow /go/dealersearch/logDealerLead* -
Disallow /go/search/newBuyIndex.jsp* -
Disallow /go/search/dealerWebsite.jsp* -
Disallow /go/video/motorweek/videoPopup.jsp* -
Disallow /shopping/certified-preowned/ -
Disallow /shopping/new/ -
Disallow /shopping/results/ -
Disallow /dealers/*/inventory/ -
Disallow *ni%3D1* -
Disallow *ni%3D2* -
Disallow *ni%3D3* -
Disallow */specialoffers/ -
Disallow /vehicle/ -
Disallow /vehicledetail/ -
Disallow /dealers/*/reviews/*/ -
Disallow /research/*/consumer-reviews/*/ -
Disallow */write-review/ -
Disallow */?reviewTags* -
Disallow */dealer_reviews/new/ -
Disallow */employees/ -

Other Records

Field Value
sitemap https://www.cars.com/secure/sitemap/s_sitemap_index.xml

Comments

  • Individual Review Crawl Control
  • DR