shop.diesel.com
robots.txt

Robots Exclusion Standard data for shop.diesel.com

Resource Scan

Scan Details

Site Domain shop.diesel.com
Base Domain diesel.com
Scan Status Ok
Last Scan2025-03-25T20:32:25+00:00
Next Scan 2025-04-24T20:32:25+00:00

Last Scan

Scanned2025-03-25T20:32:25+00:00
URL https://shop.diesel.com/robots.txt
Domain IPs 104.16.212.238, 104.16.213.238
Response IP 104.16.212.238
Found Yes
Hash ef3a00f06bbf8c0163a6f0c1e845ac9579b980b9cd13b14c22e463d92cf81ad8
SimHash c4f4aee2005a

Groups

*

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*Product-Show*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart$
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

googlebot

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart$
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

adsbot-google

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart$
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

googlebot-image

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart$
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

Other Records

Field Value
sitemap https://shop.diesel.com/sitemap_index.xml

Comments

  • 27/03/18 feed mod - start
  • Disallow: /*search-show?q=*