bikkea.com
robots.txt
Robots Exclusion Standard data for bikkea.com
Resource Scan
Scan Details
| Site Domain | bikkea.com |
| Base Domain | bikkea.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-14T17:45:06+00:00 |
| Next Scan | 2024-12-13T17:45:06+00:00 |
Last Successful Scan
| Scanned | 2024-08-16T17:44:03+00:00 |
| URL | https://bikkea.com/robots.txt |
| Redirect | https://www.bikkea.com/robots.txt |
| Redirect Domain | www.bikkea.com |
| Redirect Base | bikkea.com |
| Domain IPs | 2a00:1d70:c01c::172:227, 5.145.172.227 |
| Redirect IPs | 2a00:1d70:c01c::172:227, 5.145.172.227 |
| Response IP | 5.145.172.227 |
| Found | Yes |
| Hash | 811508a620adc78746d5a5c0d29263d7fb4d69c19cf81b27adcf318cb88c8cad |
| SimHash | ca328822a2cb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /aviso-legal.html |
| Disallow | /condiciones-uso.html |
| Disallow | /contacto.html |
| Disallow | /politica-cookies.html |
| Disallow | /politica-privacidad.html |
| Disallow | /publicidad.html |
| Disallow | /quienes-somos.html |
| Disallow | /test-producto.html |
| Disallow | /tu-tienda.html |
| Disallow | /includes/ |
| Disallow | /*.js$ |
| Disallow | /*.js?*$ |
| Disallow | /*.css$ |
| Disallow | /*.css?*$ |
| Disallow | /*.php$ |
| Disallow | /*.php?*$ |
| Disallow | /*.json$ |
| Disallow | /*.json?*$ |
| Disallow | /*enlace.html$ |
| Disallow | /*enlace.html?*$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |