abc.es
robots.txt

Robots Exclusion Standard data for abc.es

Resource Scan

Scan Details

Site Domain abc.es
Base Domain abc.es
Scan Status Ok
Last Scan2025-03-10T00:50:17+00:00
Next Scan 2025-03-17T00:50:17+00:00

Last Scan

Scanned2025-03-10T00:50:17+00:00
URL https://abc.es/robots.txt
Redirect https://www.abc.es/robots.txt
Redirect Domain www.abc.es
Redirect Base abc.es
Domain IPs 151.101.131.42, 151.101.195.42, 151.101.3.42, 151.101.67.42
Redirect IPs 151.101.131.42, 151.101.195.42, 151.101.3.42, 151.101.67.42
Response IP 199.232.47.42
Found Yes
Hash a93d41defd526992c9b2673e885deb2dab1ee7ed63a85293f479f85d8756129e
SimHash 22304772fa73

Groups

*

Rule Path
Disallow /tmp/
Disallow /*/undefined/*
Disallow /temas-resultados/
Disallow /temas-*/indice/
Disallow /hemeroteca/*
Disallow /elecciones/generales/resultados/
Disallow /en-detalle
Disallow /*/en-detalle
Disallow /addineyeV2.html
Disallow /DARTIframe.html
Disallow /doubleclick
Disallow /eyeblaster
Disallow /images/
Disallow /imag/
Disallow /imagenes/
Disallow /includes/
Disallow /wp-admin/
Disallow /*/wp-admin/
Disallow /hoyinversion/
Disallow /finanzas/
Disallow /comunabc/Widgets/rss/
Disallow /hoysport/
Disallow /recortes/
Disallow /recortes/*
Disallow /summum/recortes/
Disallow /summum/recortes/*
Disallow /play/recortes/
Disallow /play/recortes/*
Disallow /teknologica/
Disallow /Syd/
Disallow /*.swf$
Disallow /*.tif$
Disallow /*.flv$
Disallow /*.mp4$
Disallow /*.avi$
Disallow /*.inc$
Disallow /*.ics$
Disallow /*.json$
Disallow /*.geojson$
Disallow /*-ntps.html$
Disallow /prensa-historico/200*
Disallow /prensa-historico/2010*
Disallow /RC/*.xml$
Disallow /abc2010/nacional/noticias/*.xml$
Disallow /includes_comun/modulos_automaticos/
Disallow /premiogastronomico/mejor.asp?search=&page=*
Disallow /*/1$
Disallow /*/%3C$
Disallow /wp-content/
Disallow *//.html
Disallow /temas-*%7C%7Chttp%3A//resizer
Disallow */home$
Disallow /xml-sindicacion/
Disallow /sindicacion/
Disallow /c1m/menu/time/
Disallow /4900/webm.ABC/
Disallow /gl-d/
Disallow /*/gl-d$
Disallow /ht-d/
Disallow /*/ht-d$
Disallow /bb-d/
Disallow /*/bb-d$
Disallow /deportes/futbol/directos/*/2010-2011/*
Disallow /deportes/futbol/directos/*/2011-2012/*
Disallow /deportes/futbol/directos/*/2012-2013/*
Disallow /deportes/futbol/directos/*/2013-2014/*
Disallow /deportes/futbol/directos/*/2014-2015/*
Disallow /deportes/futbol/directos/*/2015-2016/*
Disallow /play/foro/*
Disallow /archivo/buscador/*
Disallow /archivo/periodicos/*-*-*-*.html
Disallow /fe-de-ratas/
Disallow /el-sacapuntas/
Disallow /loteria-de-navidad/comprobar-loteria-navidad/numero-*.html?*
Disallow /gurme/*/busqueda/?
Disallow */aggregate*
Disallow /includes_comun/*
Disallow /*?cartelera_cine
Disallow /acd/
Disallow /recetasderechupete/?s=

twitterbot

Rule Path
Allow *

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Comments

  • CSV 925679

Warnings

  • 2 invalid lines.