au.diesel.com
robots.txt
Robots Exclusion Standard data for au.diesel.com
Resource Scan
Scan Details
| Site Domain | au.diesel.com |
| Base Domain | diesel.com |
| Scan Status | Ok |
| Last Scan | 2025-03-25T12:00:10+00:00 |
| Next Scan | 2025-04-24T12:00:10+00:00 |
Last Scan
| Scanned | 2025-03-25T12:00:10+00:00 |
| URL | https://au.diesel.com/robots.txt |
| Domain IPs | 104.16.212.238, 104.16.213.238 |
| Response IP | 104.16.213.238 |
| Found | Yes |
| Hash | f7526ad8e565eff7d5aa01e699774d45bde8e928857a85ba45eab8ca3fdf2154 |
| SimHash | 44f4afa302da |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*Home-Login/* |
| Disallow | /*product-variation* |
| Disallow | /*Resources-Load* |
| Disallow | /*product-detail* |
| Disallow | /*Product-Show* |
| Disallow | /*account-password-Reset* |
| Disallow | /*wishlist-add* |
| Disallow | /*undefined* |
| Disallow | /*placeholder* |
| Disallow | /*account* |
| Disallow | /*cart* |
| Disallow | /*search-show?q=* |
| Disallow | /*prefv* |
| Disallow | /*prefn* |
| Disallow | /*dwcont* |
| Disallow | /*pmpt* |
| Disallow | /*pmid* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*Home-Login/* |
| Disallow | /*product-variation* |
| Disallow | /*Resources-Load* |
| Disallow | /*product-detail* |
| Disallow | /*account-password-Reset* |
| Disallow | /*wishlist-add* |
| Disallow | /*undefined* |
| Disallow | /*placeholder* |
| Disallow | /*account* |
| Disallow | /*cart* |
| Disallow | /*search-show?q=* |
| Disallow | /*prefv* |
| Disallow | /*prefn* |
| Disallow | /*dwcont* |
| Disallow | /*pmpt* |
| Disallow | /*pmid* |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /*Home-Login/* |
| Disallow | /*product-variation* |
| Disallow | /*Resources-Load* |
| Disallow | /*product-detail* |
| Disallow | /*account-password-Reset* |
| Disallow | /*wishlist-add* |
| Disallow | /*undefined* |
| Disallow | /*placeholder* |
| Disallow | /*account* |
| Disallow | /*cart* |
| Disallow | /*prefv* |
| Disallow | /*prefn* |
| Disallow | /*dwcont* |
| Disallow | /*pmpt* |
| Disallow | /*pmid* |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /*Home-Login/* |
| Disallow | /*product-variation* |
| Disallow | /*Resources-Load* |
| Disallow | /*product-detail* |
| Disallow | /*account-password-Reset* |
| Disallow | /*wishlist-add* |
| Disallow | /*undefined* |
| Disallow | /*placeholder* |
| Disallow | /*account* |
| Disallow | /*cart* |
| Disallow | /*search-show?q=* |
| Disallow | /*prefv* |
| Disallow | /*prefn* |
| Disallow | /*dwcont* |
| Disallow | /*pmpt* |
| Disallow | /*pmid* |
Comments