Log In Sign Up

blogs.20minutos.es
robots.txt

Robots Exclusion Standard data for blogs.20minutos.es

Resource Scan

Scan Details

Site Domain blogs.20minutos.es
Base Domain 20minutos.es
Scan Status Ok
Last Scan2024-05-25T12:49:27+00:00
Next Scan 2024-06-24T12:49:27+00:00

Last Scan

Scanned2024-05-25T12:49:27+00:00
URL https://blogs.20minutos.es/robots.txt
Domain IPs 2600:9000:2024:2a00:1a:a057:de80:93a1, 2600:9000:2024:5800:1a:a057:de80:93a1, 2600:9000:2024:5e00:1a:a057:de80:93a1, 2600:9000:2024:6e00:1a:a057:de80:93a1, 2600:9000:2024:8200:1a:a057:de80:93a1, 2600:9000:2024:9800:1a:a057:de80:93a1, 2600:9000:2024:c800:1a:a057:de80:93a1, 2600:9000:2024:fa00:1a:a057:de80:93a1, 65.9.112.43, 65.9.112.70, 65.9.112.74, 65.9.112.81
Response IP 108.157.60.18
Found Yes
Hash 3f587e402ddf670756f347fb4d6a9468c632c8c6a0a3ff278ef7c6916d19b75c
SimHash 11ff014b59e2

Groups

*

Rule Path
Disallow /*/wp-content/plugins/
Disallow /*/wp-content/themes/
Disallow /*/wp-includes/
Disallow /*/wp-admin/
Disallow /*/wp-
Disallow /*/?s=
Disallow /*/search
Disallow /*/trackback/$
Allow *.css
Allow *.js
Allow *.png

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

exabot

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

cyberalert

Rule Path
Disallow /

newscan

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

lexxebot/1.0

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sitebot/0.1

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

netseer crawler

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

discobot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

bender

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yasni

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

admantx

Rule Path
Disallow /

spbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://blogs.20minutos.es/1-de-cada-10/sitemapindex.xml
sitemap https://blogs.20minutos.es/140-y-mas/sitemapindex.xml
sitemap https://blogs.20minutos.es/150xdia/sitemapindex.xml
sitemap https://blogs.20minutos.es/adriana-abenia/sitemapindex.xml
sitemap https://blogs.20minutos.es/al-contragolpe-futbol/sitemapindex.xml
sitemap https://blogs.20minutos.es/al-mando-de-la-tele/sitemapindex.xml
sitemap https://blogs.20minutos.es/amor-sobrenatural/sitemapindex.xml
sitemap https://blogs.20minutos.es/amorin/sitemapindex.xml
sitemap https://blogs.20minutos.es/analistadeportivo/sitemapindex.xml
sitemap https://blogs.20minutos.es/animalesenadopcion/sitemapindex.xml
sitemap https://blogs.20minutos.es/arquitectacion/sitemapindex.xml
sitemap https://blogs.20minutos.es/arsenioescolar/sitemapindex.xml
sitemap https://blogs.20minutos.es/artik/sitemapindex.xml
sitemap https://blogs.20minutos.es/becario/sitemapindex.xml
sitemap https://blogs.20minutos.es/blog-solidario-cooperantes/sitemapindex.xml
sitemap https://blogs.20minutos.es/blog404/sitemapindex.xml
sitemap https://blogs.20minutos.es/bobpop/sitemapindex.xml
sitemap https://blogs.20minutos.es/boliblog/sitemapindex.xml
sitemap https://blogs.20minutos.es/cameroon-naweiti/sitemapindex.xml
sitemap https://blogs.20minutos.es/campus-ligabbva/sitemapindex.xml
sitemap https://blogs.20minutos.es/capeando-la-crisis/sitemapindex.xml
sitemap https://blogs.20minutos.es/chapiescarlata/sitemapindex.xml
sitemap https://blogs.20minutos.es/chema-martinez-no-pienses-corre/sitemapindex.xml
sitemap https://blogs.20minutos.es/chicade30/sitemapindex.xml
sitemap https://blogs.20minutos.es/ciencia/sitemapindex.xml
sitemap https://blogs.20minutos.es/ciencia-para-llevar-csic/sitemapindex.xml
sitemap https://blogs.20minutos.es/ciencias-mixtas/sitemapindex.xml
sitemap https://blogs.20minutos.es/cine-el-cielo-sobre-tatooine/sitemapindex.xml
sitemap https://blogs.20minutos.es/cine-estado-critico/sitemapindex.xml
sitemap https://blogs.20minutos.es/claves-electorales/sitemapindex.xml
sitemap https://blogs.20minutos.es/coches-electricos-hibridos/sitemapindex.xml
sitemap https://blogs.20minutos.es/codigo-abierto/sitemapindex.xml
sitemap https://blogs.20minutos.es/comics/sitemapindex.xml
sitemap https://blogs.20minutos.es/comunicacion-no-verbal-lo-que-no-nos-cuentan/sitemapindex.xml
sitemap https://blogs.20minutos.es/con-reservas/sitemapindex.xml
sitemap https://blogs.20minutos.es/conejo-frustrado/sitemapindex.xml
sitemap https://blogs.20minutos.es/coolture-club/sitemapindex.xml
sitemap https://blogs.20minutos.es/cronicaverde/sitemapindex.xml
sitemap https://blogs.20minutos.es/cruzdelsur/sitemapindex.xml
sitemap https://blogs.20minutos.es/dando-la-nota/sitemapindex.xml
sitemap https://blogs.20minutos.es/deportes-el-ultimo-tiro/sitemapindex.xml
sitemap https://blogs.20minutos.es/deportes-sputnik-basket-time/sitemapindex.xml
sitemap https://blogs.20minutos.es/descorchevinos/sitemapindex.xml
sitemap https://blogs.20minutos.es/desde-otro-angulo/sitemapindex.xml
sitemap https://blogs.20minutos.es/desternillablog/sitemapindex.xml
sitemap https://blogs.20minutos.es/diariodelibrera/sitemapindex.xml
sitemap https://blogs.20minutos.es/ecos-de-sociedad-anonima/sitemapindex.xml
sitemap https://blogs.20minutos.es/efemerides/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-abaco/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-blog-de-isasaweis/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-blog-de-lilih-blue/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-confesionario/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-nutricionista-de-la-general/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-ropero-de-letizia/sitemapindex.xml
sitemap https://blogs.20minutos.es/el-telescopio/sitemapindex.xml
sitemap https://blogs.20minutos.es/el_10_futbol/sitemapindex.xml
sitemap https://blogs.20minutos.es/elecciones/sitemapindex.xml
sitemap https://blogs.20minutos.es/emilio-rey-capturando-temperie/sitemapindex.xml
sitemap https://blogs.20minutos.es/en-capitulos-anteriores/sitemapindex.xml
sitemap https://blogs.20minutos.es/eneko/sitemapindex.xml
sitemap https://blogs.20minutos.es/enguerra/sitemapindex.xml
sitemap https://blogs.20minutos.es/entradagratuita/sitemapindex.xml
sitemap https://blogs.20minutos.es/errores-y-erratas/sitemapindex.xml
sitemap https://blogs.20minutos.es/estoy-dramatizando/sitemapindex.xml
sitemap https://blogs.20minutos.es/europa-inquieta/sitemapindex.xml
sitemap https://blogs.20minutos.es/ezcritor/sitemapindex.xml
sitemap https://blogs.20minutos.es/ezcultura/sitemapindex.xml
sitemap https://blogs.20minutos.es/fiebre-del-sabado-noche/sitemapindex.xml
sitemap https://blogs.20minutos.es/firma-invitada/sitemapindex.xml
sitemap https://blogs.20minutos.es/formula-1-alonso/sitemapindex.xml
sitemap https://blogs.20minutos.es/formula1-adrian-valles/sitemapindex.xml
sitemap https://blogs.20minutos.es/fuentesycharcos/sitemapindex.xml
sitemap https://blogs.20minutos.es/goldman-sachs-is-not-an-after-shave/sitemapindex.xml
sitemap https://blogs.20minutos.es/gran-hermano/sitemapindex.xml
sitemap https://blogs.20minutos.es/guirienespana/sitemapindex.xml
sitemap https://blogs.20minutos.es/jorge-lorenzo/sitemapindex.xml
sitemap https://blogs.20minutos.es/juegos-olimpicos/sitemapindex.xml
sitemap https://blogs.20minutos.es/la-energia-como-derecho/sitemapindex.xml
sitemap https://blogs.20minutos.es/la-gulateca/sitemapindex.xml
sitemap https://blogs.20minutos.es/la-hora-del-te-amigos-ingleses/sitemapindex.xml
sitemap https://blogs.20minutos.es/latino/sitemapindex.xml
sitemap https://blogs.20minutos.es/leer-no-mata/sitemapindex.xml
sitemap https://blogs.20minutos.es/letrasdecambio/sitemapindex.xml
sitemap https://blogs.20minutos.es/london-bloggin-2/sitemapindex.xml
sitemap https://blogs.20minutos.es/lucesdeposicion/sitemapindex.xml
sitemap https://blogs.20minutos.es/madreconadolescentes/sitemapindex.xml
sitemap https://blogs.20minutos.es/madrereciente/sitemapindex.xml
sitemap https://blogs.20minutos.es/manolosaco/sitemapindex.xml
sitemap https://blogs.20minutos.es/mara-viste-y-calza/sitemapindex.xml
sitemap https://blogs.20minutos.es/martacibelina/sitemapindex.xml
sitemap https://blogs.20minutos.es/martinezsoler/sitemapindex.xml
sitemap https://blogs.20minutos.es/mas-de-la-mitad/sitemapindex.xml
sitemap https://blogs.20minutos.es/masquemedios/sitemapindex.xml
sitemap https://blogs.20minutos.es/mati-una-profesora-muy-particular/sitemapindex.xml
sitemap https://blogs.20minutos.es/nilibreniocupado/sitemapindex.xml
sitemap https://blogs.20minutos.es/nodiga33/sitemapindex.xml
sitemap https://blogs.20minutos.es/ocu-la-voz-de-los-consumidores/sitemapindex.xml
sitemap https://blogs.20minutos.es/ohmyblog/sitemapindex.xml
sitemap https://blogs.20minutos.es/oriente-occidente/sitemapindex.xml
sitemap https://blogs.20minutos.es/ot/sitemapindex.xml
sitemap https://blogs.20minutos.es/plano-contrapicado-cine/sitemapindex.xml
sitemap https://blogs.20minutos.es/poesia/sitemapindex.xml
sitemap https://blogs.20minutos.es/preferirianohacerlo/sitemapindex.xml
sitemap https://blogs.20minutos.es/premios20blogs/sitemapindex.xml
sitemap https://blogs.20minutos.es/que-fue-de-todos-los-demas/sitemapindex.xml
sitemap https://blogs.20minutos.es/que-la-publi-te-acompane/sitemapindex.xml
sitemap https://blogs.20minutos.es/que-paso-en-el-mundial/sitemapindex.xml
sitemap https://blogs.20minutos.es/quefuede/sitemapindex.xml
sitemap https://blogs.20minutos.es/quemepongo/sitemapindex.xml
sitemap https://blogs.20minutos.es/rafanadaltenis/sitemapindex.xml
sitemap https://blogs.20minutos.es/reality-blog-show/sitemapindex.xml
sitemap https://blogs.20minutos.es/reporteros/sitemapindex.xml
sitemap https://blogs.20minutos.es/retiario/sitemapindex.xml
sitemap https://blogs.20minutos.es/revelados/sitemapindex.xml
sitemap https://blogs.20minutos.es/rickyrubionbabasket/sitemapindex.xml
sitemap https://blogs.20minutos.es/rosyrunrun/sitemapindex.xml
sitemap https://blogs.20minutos.es/runstorming-spanjaard/sitemapindex.xml
sitemap https://blogs.20minutos.es/salud_y_deporte/sitemapindex.xml
sitemap https://blogs.20minutos.es/salvatierra/sitemapindex.xml
sitemap https://blogs.20minutos.es/sextacolumna/sitemapindex.xml
sitemap https://blogs.20minutos.es/siempre-en-ruta/sitemapindex.xml
sitemap https://blogs.20minutos.es/sinefectos/sitemapindex.xml
sitemap https://blogs.20minutos.es/smelly-cat/sitemapindex.xml
sitemap https://blogs.20minutos.es/solo-un-capitulo-mas-series/sitemapindex.xml
sitemap https://blogs.20minutos.es/talking-in-silver/sitemapindex.xml
sitemap https://blogs.20minutos.es/tanta-europa/sitemapindex.xml
sitemap https://blogs.20minutos.es/todo-es-coyuntura/sitemapindex.xml
sitemap https://blogs.20minutos.es/trasdos/sitemapindex.xml
sitemap https://blogs.20minutos.es/tu-blog/sitemapindex.xml
sitemap https://blogs.20minutos.es/un-cuento-corriente/sitemapindex.xml
sitemap https://blogs.20minutos.es/un-hogar-con-mucho-oficio/sitemapindex.xml
sitemap https://blogs.20minutos.es/una-de-cada-mil/sitemapindex.xml
sitemap https://blogs.20minutos.es/urbaneja/sitemapindex.xml
sitemap https://blogs.20minutos.es/urna/sitemapindex.xml
sitemap https://blogs.20minutos.es/videoblog/sitemapindex.xml
sitemap https://blogs.20minutos.es/videojuegos/sitemapindex.xml
sitemap https://blogs.20minutos.es/viento-de-levante/sitemapindex.xml
sitemap https://blogs.20minutos.es/visual20/sitemapindex.xml
sitemap https://blogs.20minutos.es/xx-siglos/sitemapindex.xml
sitemap https://blogs.20minutos.es/yaestaellistoquetodolosabe/sitemapindex.xml
sitemap https://blogs.20minutos.es/yotambientequiero/sitemapindex.xml
Back to top

Comments

  • Sitemaps
  • Agentes bloqueados por idioma
  • Agentes nocivos
Back to top

Warnings

  • 4 invalid lines.
Back to top