el-mundo.es
robots.txt
Robots Exclusion Standard data for el-mundo.es
Resource Scan
Scan Details
| Site Domain | el-mundo.es |
| Base Domain | el-mundo.es |
| Scan Status | Ok |
| Last Scan | 2024-10-22T18:55:16+00:00 |
| Next Scan | 2024-11-21T18:55:16+00:00 |
Last Scan
| Scanned | 2024-10-22T18:55:16+00:00 |
| URL | http://www.el-mundo.es/robots.txt |
| Redirect | https://www.elmundo.es/robots.txt |
| Redirect Domain | www.elmundo.es |
| Redirect Base | elmundo.es |
| Domain IPs | 193.110.128.109, 2001:67c:2294:1000::f109 |
| Redirect IPs | 199.232.193.50, 199.232.197.50 |
| Response IP | 146.75.41.50 |
| Found | Yes |
| Hash | 59bab9699122718320053be2635281fff0c1c1bdb61393001aa8efd1fc6b7624 |
| SimHash | 331a700089e7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /1998/ |
| Disallow | /2002/ |
| Disallow | /s/ |
| Disallow | /cgi-bin/ |
| Disallow | /perl/ |
| Disallow | /foros/ |
| Disallow | /yodona/hemeroteca/ |
| Disallow | /metropoli/hemeroteca/ |
| Disallow | /eventos/en-directo/*.json |
| Disallow | /eventos/en-directo/resources.html* |
| Disallow | /noticias/envia_noticia.html |
| Disallow | /enviaropinion.html?* |
| Disallow | /apw.js* |
| Disallow | */pruebas-abierto/* |
| Disallow | */elmundo/hemeroteca/*/*/*/*/* |
| Allow | */elmundo/hemeroteca/*/*/*/*/index* |
Warnings
- 2 invalid lines.
Comments