all-spares.com
robots.txt
Robots Exclusion Standard data for all-spares.com
Resource Scan
Scan Details
| Site Domain | all-spares.com |
| Base Domain | all-spares.com |
| Scan Status | Ok |
| Last Scan | 2024-05-29T17:50:38+00:00 |
| Next Scan | 2024-06-05T17:50:38+00:00 |
Last Scan
| Scanned | 2024-05-29T17:50:38+00:00 |
| URL | https://all-spares.com/robots.txt |
| Domain IPs | 104.21.95.34, 172.67.142.165, 2606:4700:3032::6815:5f22, 2606:4700:3034::ac43:8ea5 |
| Response IP | 172.67.142.165 |
| Found | Yes |
| Hash | 04e9efc643321213e67724bc0e386a30a3a17ef85efa6eadf22ec0df8c300776 |
| SimHash | 3ba8da494ef7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/block/quick-search |
| Disallow | /*/block/menu/ |
| Disallow | /*/block/promo-carousel/ |
| Disallow | /*/block/recent/ |
| Disallow | /*/block/estimate/ |
| Disallow | /*/block/re-captcha/ |
| Disallow | /*/block/user/login/ |
| Disallow | /*/block/product/wait-list/ |
| Disallow | /*/block/product/quality/ |
| Disallow | /*/block/product/delivery/ |
| Disallow | /*/save/user* |
| Disallow | /*/save/cart* |
| Disallow | /*/save/checkout* |
| Disallow | /*/delete/cart* |
| Disallow | /*/delete/user* |
| Disallow | /*/cart/ |
| Disallow | /*/user/ |
| Disallow | /*/account/ |
| Disallow | /*/search/ |
| Disallow | /*/utility/ |
| Disallow | /*/order/ |
| Disallow | /*/checkout/ |
| Disallow | /*/processpayment/ |
| Disallow | /*/email/ |
| Disallow | /*/order-summary/ |
| Disallow | /*/facet/ |
| Disallow | /*/product/compare |
| Disallow | /*/find-solution/*brand%3D* |
| Disallow | /1234152/ |
| Allow | */catalogue/*/*page* |
| Allow | */articles-and-video/*page* |
| Allow | */news/*page* |
| Disallow | *brand%3D*%2C* |
| Disallow | *brand_id%3D* |
| Disallow | *properties%3D* |
| Disallow | *from%3D* |
| Disallow | *promo%3D*%2C* |
| Disallow | *si%3D* |
| Disallow | *type%3D* |
| Disallow | *q%3D* |
| Disallow | *filter%5BPPV%5D%3D* |
| Disallow | *filter%5BPPV%5D%3D* |
| Disallow | *filter%5BFL%5D%3D* |
| Disallow | *filter%5BFL%5D%3D* |
| Disallow | *filter%5BPrice%5D%3D* |
| Disallow | *filter%5BPrice%5D%3D* |
| Disallow | *filter%5BPR%5D%3D* |
| Disallow | *filter%5BPR%5D%3D* |
| Disallow | *filter%5BS%5D%3D* |
| Disallow | *filter%5BS%5D%3D* |
| Disallow | *filter%5BNU%5D%3D* |
| Disallow | *filter%5BNU%5D%3D* |
| Disallow | *utm_source%3D* |
| Disallow | *utm_expid%3D* |
| Disallow | *gclid%3D* |
| Disallow | *cnt_page%3D* |
| Disallow | *dt%3D* |
| Disallow | *np%3D* |
| Disallow | *sy%3D* |
| Disallow | *cat%3D* |
| Disallow | *wf%3D* |
| Disallow | *ul%3D* |
| Disallow | *ps%3D* |
| Disallow | *.exe$ |
| Disallow | *.zip$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://all-spares.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments