eshop.wurth.be
robots.txt
Robots Exclusion Standard data for eshop.wurth.be
Resource Scan
Scan Details
| Site Domain | eshop.wurth.be |
| Base Domain | wurth.be |
| Scan Status | Ok |
| Last Scan | 2026-02-25T05:26:11+00:00 |
| Next Scan | 2026-03-11T05:26:11+00:00 |
Last Scan
| Scanned | 2026-02-25T05:26:11+00:00 |
| URL | https://eshop.wurth.be/robots.txt |
| Domain IPs | 185.101.4.33, 2a06:1a80:0:4::33 |
| Response IP | 185.101.4.33 |
| Found | Yes |
| Hash | 364d991ac4e9a1183fd452df121ae97663d7cbd1a9f1996e71880f1df949f7e2 |
| SimHash | d3082d704511 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*oauth*?*redirect_uri |
| Disallow | /*authorize*?*redirect_uri |
| Disallow | /is-bin/INTERSHOP.enfinity/ |
| Disallow | /*ViewRequisition-ViewOrderSummary |
| Disallow | /ISO-Katalog/ |
| Disallow | /DIN-Katalog/ |
| Disallow | /DIN-catalog/ |
| Disallow | /ISO-catalog/ |
| Disallow | /E-mobility/ |
| Disallow | /Modyf/ |
| Disallow | /-/e_mobility.cyid/ |
| Disallow | /-/Modyf.cyid/ |
| Disallow | /catalogue/-/ |
| Disallow | /*/*.sku$ |
| Disallow | /scanupload |
| Disallow | /Catalogue-general/ |
| Disallow | */pl/PL/EUR/* |
| Disallow | */pt/PT/EUR/* |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /is-bin/INTERSHOP.enfinity/*/ViewModelDetail-AjaxRetrieveModelProductsTable |
| Allow | /is-bin/INTERSHOP.enfinity/*/ViewModelDetail-AjaxRetrieveRecommendedModels |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://eshop.wurth.be/sitemap/3103/index-sitemap.xml |