eshop.wurth.pl
robots.txt
Robots Exclusion Standard data for eshop.wurth.pl
Resource Scan
Scan Details
| Site Domain | eshop.wurth.pl |
| Base Domain | wurth.pl |
| Scan Status | Ok |
| Last Scan | 2026-02-20T11:46:21+00:00 |
| Next Scan | 2026-03-06T11:46:21+00:00 |
Last Scan
| Scanned | 2026-02-20T11:46:21+00:00 |
| URL | https://eshop.wurth.pl/robots.txt |
| Domain IPs | 104.69.34.109, 2600:1413:5000:a80::a9e, 2600:1413:5000:a8a::a9e |
| Response IP | 23.203.77.111 |
| Found | Yes |
| Hash | 28813c74d5d61320e543ec7e4d815845a5b677584c358211c4e04fa19f1ce35d |
| SimHash | e5006c30c313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*oauth*?*redirect_uri |
| Disallow | /*authorize*?*redirect_uri |
| Disallow | /is-bin/INTERSHOP.enfinity/ |
| Disallow | /*ViewRequisition-ViewOrderSummary |
| Disallow | /ISO-Katalog/ |
| Disallow | /DIN-Katalog/ |
| Disallow | /ISO-catalog/ |
| Disallow | /DIN-catalog/ |
| Disallow | /PROMOCJE/ |
| Disallow | /-/PROMOCJE.cyid/ |
| Disallow | /Aplikacja-Mobilna/ |
| Disallow | /catalogue/-/ |
| Disallow | /*/*.sku$ |
| Disallow | /scanupload |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /is-bin/INTERSHOP.enfinity/*/ViewModelDetail-AjaxRetrieveModelProductsTable |
| Allow | /is-bin/INTERSHOP.enfinity/*/ViewModelDetail-AjaxRetrieveRecommendedModels |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://eshop.wurth.pl/sitemap/3111/index-sitemap.xml |