maxcolchon.com
robots.txt
Robots Exclusion Standard data for maxcolchon.com
Resource Scan
Scan Details
| Site Domain | maxcolchon.com |
| Base Domain | maxcolchon.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-05T10:33:39+00:00 |
| Next Scan | 2024-12-04T10:33:39+00:00 |
Last Successful Scan
| Scanned | 2024-04-16T07:52:50+00:00 |
| URL | https://maxcolchon.com/robots.txt |
| Redirect | https://www.maxcolchon.com/robots.txt |
| Redirect Domain | www.maxcolchon.com |
| Redirect Base | maxcolchon.com |
| Domain IPs | 104.22.14.97, 104.22.15.97, 172.67.27.182, 2606:4700:10::6816:e61, 2606:4700:10::6816:f61, 2606:4700:10::ac43:1bb6 |
| Redirect IPs | 104.22.14.97, 104.22.15.97, 172.67.27.182, 2606:4700:10::6816:e61, 2606:4700:10::6816:f61, 2606:4700:10::ac43:1bb6 |
| Response IP | 104.22.14.97 |
| Found | Yes |
| Hash | d009c87e835fe0c911707ba10490abefe6ab2db679fd5b21b473d383ae771bad |
| SimHash | 664581709593 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*%2C* |
| Disallow | /cupon* |
| Disallow | /sensaciones-videos-colchon/* |
| Disallow | /ajax/* |
| Disallow | /ShoppingCart* |
| Disallow | /comprar/* |
| Disallow | /medidas/* |
| Disallow | /*.pdf$ |
| Disallow | /it/* |
| Disallow | /exposicion-c-97/* |
| Disallow | /regalos-clientes-c-79/* |
| Disallow | /anulados-c-48/* |
| Disallow | /diccionariodecolchones/* |
| Disallow | /tags/* |
| Allow | /*.js$ |
| Allow | /*.css$ |
| Disallow | |
| Disallow | /seguridad-cms.html |
| Disallow | /politica-privacidad-cms.html |
| Disallow | /confianza-online-cms.html |
| Disallow | /politica-cookies-cms.html |
| Disallow | /aviso-legal-cms.html |
| Disallow | /condiciones-generales-cms.html |
| Disallow | /area-de-cliente |
| Disallow | /sala-prensa-cms.html |
| Disallow | /pt/*%2C* |
| Disallow | /pt/cupon* |
| Disallow | /pt/ajax/* |
| Disallow | /pt/ShoppingCart* |
| Disallow | /pt/comprar/* |
| Disallow | /pt/medidas/* |
| Disallow | /pt/*.pdf$ |
| Disallow | /pt/dicionariodecolchoes/* |
| Disallow | /pt/noticiasdecolchoes/* |
| Disallow | /pt/tags/* |
| Allow | /pt/*.js$ |
| Allow | /pt/*.css$ |
| Disallow | /fr/*%2C* |
| Disallow | /fr/cupon* |
| Disallow | /fr/ajax/* |
| Disallow | /fr/ShoppingCart* |
| Disallow | /*.pdf$ |
| Disallow | /fr/informationsmatelas/* |
| Disallow | /fr/dictionnairedematelas/* |
| Disallow | /fr/tags/* |
| Allow | /fr/*.js$ |
| Allow | /fr/*.css$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.maxcolchon.com/sitemap.xml |
| sitemap | https://www.maxcolchon.com/pt/sitemap.xml |
| sitemap | https://www.maxcolchon.com/fr/sitemap.xml |
Warnings
- 1 invalid line.
- `visit-time` is not a known field.