heraldo.es
robots.txt
Robots Exclusion Standard data for heraldo.es
Resource Scan
Scan Details
| Site Domain | heraldo.es |
| Base Domain | heraldo.es |
| Scan Status | Ok |
| Last Scan | 2024-11-16T09:09:06+00:00 |
| Next Scan | 2024-11-23T09:09:06+00:00 |
Last Scan
| Scanned | 2024-11-16T09:09:06+00:00 |
| URL | https://heraldo.es/robots.txt |
| Redirect | https://www.heraldo.es/robots.txt |
| Redirect Domain | www.heraldo.es |
| Redirect Base | heraldo.es |
| Domain IPs | 3.160.196.104, 3.160.196.125, 3.160.196.78, 3.160.196.83 |
| Redirect IPs | 65.9.112.10, 65.9.112.106, 65.9.112.18, 65.9.112.63 |
| Response IP | 52.85.49.70 |
| Found | Yes |
| Hash | e7788d53c533171232071bcbabd8b67039360c0212f1bc28de4ae8be0dd228d0 |
| SimHash | f0fa31c085f6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /buscar |
| Disallow | /view/ |
| Disallow | /view/* |
| Disallow | /contacta/ |
| Disallow | /contacta/* |
| Disallow | /*.woff2$ |
| Disallow | /ocio/ocio/ |
| Disallow | /ocio/node/ |
| Disallow | /ocio/eventos/busqueda/ |
| Disallow | /ocio/busqueda/ |
Warnings
- 2 invalid lines.
Comments