accuratediesel.com
robots.txt
Robots Exclusion Standard data for accuratediesel.com
Resource Scan
Scan Details
| Site Domain | accuratediesel.com |
| Base Domain | accuratediesel.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-19T16:46:37+00:00 |
| Next Scan | 2025-10-17T16:46:37+00:00 |
Last Successful Scan
| Scanned | 2025-02-27T05:16:47+00:00 |
| URL | https://accuratediesel.com/robots.txt |
| Domain IPs | 104.16.39.93, 104.16.40.93, 104.16.41.93, 104.16.42.93, 104.16.43.93, 2606:4700::6810:275d, 2606:4700::6810:285d, 2606:4700::6810:295d, 2606:4700::6810:2a5d, 2606:4700::6810:2b5d |
| Response IP | 104.16.42.93 |
| Found | Yes |
| Hash | c7e9341cdf794e43a17e1d79452e843b293022d0d368f2c883d5551ccf75e812 |
| SimHash | bac00113c4e5 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /store/adm | Crawlers do not need access to your console, so this rule disallows all console pages for crawlers |
| Disallow | /store/shopCa | Crawlers cannot add items to a shopping cart, so prevent them from viewing this page |
| Disallow | /store/WriteR | Crawlers cannot submit product reviews, so there is no need for them to view this page. The content of product reviews is on a separate page that is allowed |
| Disallow | /store/addtoc | is used in embedded commerce and allows items to be added to the cart. There is no content on this page and therefore crawlers do not need to see it. |
| Disallow | /store/OnePageCh | generally contains no inherent SEO value, and crawlers cannot add items to their cart to be able to access this page, therefore it is disallowed |
| Disallow | /store/checko | This page contains no content |
| Disallow | /*Attrib%3D | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
| Disallow | /*?Attrib= | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
| Disallow | *attribs%3D | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
| Disallow | *Attribs%3D | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Product | Comment |
|---|---|
| * | These rules apply to all crawlers |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /store/adm | Crawlers do not need access to your console, so this rule disallows all console pages for crawlers |
| Disallow | /store/shopCa | Crawlers cannot add items to a shopping cart, so prevent them from viewing the cart page |
| Disallow | /store/WriteR | Crawlers cannot submit product reviews, so there is no need for them to view this page. The content of product reviews is on a separate page that is allowed |
| Disallow | /store/addtoc | is used in embedded commerce and allows items to be added to the cart. There is no content on this page and therefore crawlers do not need to see it. |
| Disallow | /store/OnePageCh | generally contains no inherent SEO value, and crawlers cannot add items to their cart to be able to access this page, therefore it is disallowed |
| Disallow | /store/checko | This page contains no content |
| Disallow | /*Attrib%3D | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
| Disallow | /*?Attrib= | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
| Disallow | *attribs%3D | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
| Disallow | *Attribs%3D | If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. |
Comments