wurth.es
robots.txt
Robots Exclusion Standard data for wurth.es
Resource Scan
Scan Details
| Site Domain | wurth.es |
| Base Domain | wurth.es |
| Scan Status | Ok |
| Last Scan | 2024-09-27T06:32:17+00:00 |
| Next Scan | 2024-10-11T06:32:17+00:00 |
Last Scan
| Scanned | 2024-09-27T06:32:17+00:00 |
| URL | https://wurth.es/robots.txt |
| Redirect | https://www.wurth.es/robots.txt |
| Redirect Domain | www.wurth.es |
| Redirect Base | wurth.es |
| Domain IPs | 151.101.131.42, 151.101.195.42, 151.101.3.42, 151.101.67.42 |
| Redirect IPs | 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52 |
| Response IP | 199.232.47.52 |
| Found | Yes |
| Hash | 768a780123014ed8173826034853862cfcdc8ab3e62bbc08563303c503dcbce3 |
| SimHash | c534c829c91b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /customer/ |
| Disallow | /lib/ |
| Disallow | /*.php$ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /var/ |
| Disallow | /sendfriend/ |
| Disallow | /review/ |
| Disallow | /*SID%3D |
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /pub/ |
| Disallow | /checkout/ |
| Disallow | /onestepcheckout/ |
| Disallow | /customer/ |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login |
| Disallow | /catalogsearch/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/product/view/ |
| Disallow | /*?dir* |
| Disallow | /*?dir=desc |
| Disallow | /*?dir=asc |
| Disallow | /*?limit=all |
| Disallow | /?mode |
| Disallow | *?Page= |
| Disallow | *?category_list_order= |
| Disallow | *?product_list_order= |
| Disallow | /catalogo$ |
| Disallow | /as-medicion |
| Disallow | /as-herramientas-manuales |
| Disallow | /as-brocas-coronas |
| Disallow | /as-abrasivos |
| Disallow | /as-cintas |
| Disallow | /as-electricidad |
| Disallow | /as-auto |
| Disallow | /as-herrajes-madera-metal |
| Disallow | /as-sanitarios-construccion |
| Disallow | /as-conjunto |
| Disallow | /as-accesorio-quimico |
| Disallow | /as-mecanica-neumatica |
| Disallow | /as-seguridad-higiene |
| Disallow | /as-iluminaciones |
| Disallow | /as-herramientas-corte |
| Disallow | /as-tornilleria-din |
| Disallow | /as-quimicos |
| Disallow | /as-modyf |
| Allow | /pub/sitemap/sitemap.xml$ |
| Allow | /pub/sitemap/sitemap-1-1.xml$ |
| Allow | /pub/sitemap/sitemap-1-2.xml$ |
| Allow | /pub/sitemap/sitemap-1-3.xml$ |
| Allow | /pub/sitemap/sitemap-1-4.xml$ |
| Allow | /pub/sitemap/sitemap-1-5.xml$ |
| Allow | /pub/sitemap/sitemap-1-6.xml$ |
| Allow | /pub/sitemap/sitemap-1-7.xml$ |
| Allow | /pub/sitemap/sitemap-1-8.xml$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wurth.es/sitemap/sitemap.xml |
Comments