canariasdiario.com
robots.txt
Robots Exclusion Standard data for canariasdiario.com
Resource Scan
Scan Details
Site Domain | canariasdiario.com |
Base Domain | canariasdiario.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-07T22:12:19+00:00 |
Next Scan | 2025-02-05T22:12:19+00:00 |
Last Successful Scan
Scanned | 2023-10-15T21:45:01+00:00 |
URL | https://canariasdiario.com/robots.txt |
Redirect | https://www.canariasdiario.com/robots.txt |
Redirect Domain | www.canariasdiario.com |
Redirect Base | canariasdiario.com |
Domain IPs | 104.21.5.149, 172.67.154.184, 2606:4700:3033::6815:595, 2606:4700:3033::ac43:9ab8 |
Redirect IPs | 104.21.5.149, 172.67.154.184, 2606:4700:3033::6815:595, 2606:4700:3033::ac43:9ab8 |
Response IP | 172.67.154.184 |
Found | Yes |
Hash | 84215433a1374588e80ab1995fdbeb8c03c48ba09a7153cced6a954e5cc44a92 |
SimHash | 0c3c9e508e50 |
Groups
*
Rule | Path |
---|---|
Disallow | /mailings/ |
Disallow | /mi-cuenta/ |
Disallow | /hn2/ |
Disallow | /editmaker/ |
Disallow | /estadisticas/ |
Disallow | /mvc/ajax/ |
Disallow | /mvc/movil/comentaNoticia/ |
Disallow | /comentaNoticia/ |
Disallow | /imprimir-portada.asp |
Disallow | /imprimir-noticia.asp |
Disallow | /enviar-noticia.asp |
Disallow | /fotos/modulos/ |
Disallow | /movil/cambiar_completa.php |
Disallow | /movil/cambiar_movil.php |
Disallow | /cambiar_completa.php |
Disallow | /hemeroteca/ |
Disallow | /modulos/ |
Disallow | /cdn-cgi/ |
Disallow | /buscar/ |
Disallow | /foros/ |
Disallow | /redirect.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.canariasdiario.com/sitemap.xml |