canariasdiario.com
robots.txt

Robots Exclusion Standard data for canariasdiario.com

Resource Scan

Scan Details

Site Domain canariasdiario.com
Base Domain canariasdiario.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-07T22:12:19+00:00
Next Scan 2025-02-05T22:12:19+00:00

Last Successful Scan

Scanned2023-10-15T21:45:01+00:00
URL https://canariasdiario.com/robots.txt
Redirect https://www.canariasdiario.com/robots.txt
Redirect Domain www.canariasdiario.com
Redirect Base canariasdiario.com
Domain IPs 104.21.5.149, 172.67.154.184, 2606:4700:3033::6815:595, 2606:4700:3033::ac43:9ab8
Redirect IPs 104.21.5.149, 172.67.154.184, 2606:4700:3033::6815:595, 2606:4700:3033::ac43:9ab8
Response IP 172.67.154.184
Found Yes
Hash 84215433a1374588e80ab1995fdbeb8c03c48ba09a7153cced6a954e5cc44a92
SimHash 0c3c9e508e50

Groups

*

Rule Path
Disallow /mailings/
Disallow /mi-cuenta/
Disallow /hn2/
Disallow /editmaker/
Disallow /estadisticas/
Disallow /mvc/ajax/
Disallow /mvc/movil/comentaNoticia/
Disallow /comentaNoticia/
Disallow /imprimir-portada.asp
Disallow /imprimir-noticia.asp
Disallow /enviar-noticia.asp
Disallow /fotos/modulos/
Disallow /movil/cambiar_completa.php
Disallow /movil/cambiar_movil.php
Disallow /cambiar_completa.php
Disallow /hemeroteca/
Disallow /modulos/
Disallow /cdn-cgi/
Disallow /buscar/
Disallow /foros/
Disallow /redirect.php

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.canariasdiario.com/sitemap.xml