hemeroteca.mallorcadiario.com
robots.txt

Robots Exclusion Standard data for hemeroteca.mallorcadiario.com

Resource Scan

Scan Details

Site Domain hemeroteca.mallorcadiario.com
Base Domain mallorcadiario.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T17:51:29+00:00
Next Scan 2024-08-15T17:51:29+00:00

Last Successful Scan

Scanned2023-09-28T12:29:42+00:00
URL https://hemeroteca.mallorcadiario.com/robots.txt
Redirect https://www.mallorcadiario.com/robots.txt
Redirect Domain www.mallorcadiario.com
Redirect Base mallorcadiario.com
Domain IPs 104.26.0.193, 104.26.1.193, 172.67.73.42, 2606:4700:20::681a:1c1, 2606:4700:20::681a:c1, 2606:4700:20::ac43:492a
Redirect IPs 104.26.0.193, 104.26.1.193, 172.67.73.42, 2606:4700:20::681a:1c1, 2606:4700:20::681a:c1, 2606:4700:20::ac43:492a
Response IP 172.67.73.42
Found Yes
Hash b18f9fb8a7bf26699874fffea882f3c06504d5255c3b422e6b7130aae92979c0
SimHash a11a40d2ce72

Groups

*

Rule Path
Disallow /mailings/
Disallow /mi-cuenta/
Disallow /hn2/
Disallow /editmaker/
Disallow /estadisticas/
Disallow /mvc/ajax/
Disallow /mvc/movil/comentaNoticia/
Disallow /comentaNoticia/
Disallow /imprimir-portada.asp
Disallow /imprimir-noticia.asp
Disallow /enviar-noticia.asp
Disallow /fotos/modulos/
Disallow /movil/cambiar_completa.php
Disallow /movil/cambiar_movil.php
Disallow /cambiar_completa.php
Disallow /hemeroteca/
Disallow /modulos/
Disallow /cdn-cgi/
Disallow /buscar/
Disallow /foros/
Disallow /redirect.php

baiduspider

Rule Path
Disallow /

*

Rule Path
Allow /ads.txt
Disallow /tags/
Allow /tag/elecciones-23j
Allow /tag/elecciones-28m
Allow /tag/abusos-sexuales
Allow /tag/accidente-avion
Allow /tag/acoso-escolar
Allow /tag/acoso-laboral
Allow /tag/adicciones
Allow /tag/agenciacom
Allow /tag/ayudas-autonomos
Allow /tag/balconing
Allow /tag/bicipalma
Allow /tag/beatriz-diez
Allow /tag/challenge-mallorca
Allow /tag/cicloturismo
Allow /tag/catalan-sanidad
Allow /tag/cursach
Allow /tag/copa-del-rey-de-vela
Allow /tag/desayunos-mallorcadiario.com
Allow /tag/deporte-balear
Allow /tag/diario-de-mallorca
Allow /tag/economia-balear
Allow /tag/educacion-baleares
Allow /tag/encuesta-mallorcadiario.com
Allow /tag/ferias-y-fiestas
Allow /tag/futbol-balear
Allow /tag/feria-nautica
Allow /tag/gabriel-escarrer
Allow /tag/grupo-cursach
Allow /tag/gastronomia-mallorca
Allow /tag/mallorcadiario
Allow /tag/mallorcadiario.com
Allow /tag/mamading
Disallow /*.swf$
Disallow /*.tif$
Disallow /*.mp3$
Disallow /*.flv$
Disallow /*.mp4$
Disallow /*.avi$
Disallow /*.txt$
Disallow /*.ics$

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mallorcadiario.com/sitemaps/sitemap_news.xml

Comments

  • Tags
  • Disallow: /tag/
  • Extensiones de contenidos no indexables
  • Agentes nocivos conocidos