nl.diesel.com
robots.txt

Robots Exclusion Standard data for nl.diesel.com

Resource Scan

Scan Details

Site Domain nl.diesel.com
Base Domain diesel.com
Scan Status Ok
Last Scan2025-03-25T19:46:49+00:00
Next Scan 2025-04-24T19:46:49+00:00

Last Scan

Scanned2025-03-25T19:46:49+00:00
URL https://nl.diesel.com/robots.txt
Domain IPs 104.16.212.238, 104.16.213.238
Response IP 104.16.213.238
Found Yes
Hash 7091ee738b4d41e0111ee0a1d6f3a6c85089d8da409cc5f0cea2e869f52cc313
SimHash 44f5afa302da

Groups

*

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*Product-Show*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

googlebot

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

adsbot-google

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

googlebot-image

Rule Path
Disallow /*Home-Login/*
Disallow /*product-variation*
Disallow /*Resources-Load*
Disallow /*product-detail*
Disallow /*account-password-Reset*
Disallow /*wishlist-add*
Disallow /*undefined*
Disallow /*placeholder*
Disallow /*account*
Disallow /*cart*
Disallow /*search-show?q=*
Disallow /*prefv*
Disallow /*prefn*
Disallow /*dwcont*
Disallow /*pmpt*
Disallow /*pmid*

Other Records

Field Value
sitemap https://nl.diesel.com/en/sitemap_index.xml

Comments

  • 27/03/18 feed mod - start
  • Disallow: /*search-show?q=*