ca.diesel.com
robots.txt

Robots Exclusion Standard data for ca.diesel.com

Resource Scan

Scan Details

Site Domain ca.diesel.com
Base Domain diesel.com
Scan Status Ok
Last Scan2025-03-25T21:22:33+00:00
Next Scan 2025-04-24T21:22:33+00:00

Last Scan

Scanned2025-03-25T21:22:33+00:00
URL https://ca.diesel.com/robots.txt
Domain IPs 104.16.212.238, 104.16.213.238
Response IP 104.16.212.238
Found Yes
Hash 9b59b249a8e42b6b2093b466a7bfae43c1821c479684abf29ddeb919c10c5499
SimHash 4cf4af8302da

Groups

*

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*Product-Show*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

googlebot

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

adsbot-google

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

googlebot-image

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

Other Records

Field Value
sitemap https://ca.diesel.com/sitemap_index.xml

Comments

  • 27/03/18 feed mod - start
  • Disallow: /*search-show?q=*