diariodekayak.es
robots.txt

Robots Exclusion Standard data for diariodekayak.es

Resource Scan

Scan Details

Site Domain diariodekayak.es
Base Domain diariodekayak.es
Scan Status Ok
Last Scan2025-04-05T21:10:54+00:00
Next Scan 2025-04-12T21:10:54+00:00

Last Scan

Scanned2025-04-05T21:10:54+00:00
URL https://diariodekayak.es/robots.txt
Domain IPs 51.254.152.94
Response IP 51.254.152.94
Found Yes
Hash 57349ac62a2593108bf1f05fa96d12db0415a1544c50ea890644b0136f51e2c9
SimHash b72e1414de76

Groups

agent gpt

Rule Path
Disallow /

agentgpt

Rule Path
Disallow /

aibot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

aisearchbot

Rule Path
Disallow /

alexatm

Rule Path
Disallow /

alpha ai

Rule Path
Disallow /

alphaai

Rule Path
Disallow /

amazon bedrock

Rule Path
Disallow /

amazon lex

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amelia

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

anypicker

Rule Path
Disallow /

applebot

Rule Path
Disallow /

autogpt

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

brave leo ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

catboost

Rule Path
Disallow /

cc-crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

chinchilla

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

common crawl

Rule Path
Disallow /

commoncrawl

Rule Path
Disallow /

crawlspace

Rule Path
Disallow /

crew ai

Rule Path
Disallow /

crewai

Rule Path
Disallow /

dall-e

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

deepmind

Rule Path
Disallow /

deepseek

Rule Path
Disallow /

depolarizinggpt

Rule Path
Disallow /

dialogpt

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

firecrawl

Rule Path
Disallow /

flyriver

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

gemini

Rule Path
Disallow /

gemma

Rule Path
Disallow /

genai

Rule Path
Disallow /

google bard ai

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleother

Rule Path
Disallow /

gpt-2

Rule Path
Disallow /

gpt-3

Rule Path
Disallow /

gpt-4

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

gptzero

Rule Path
Disallow /

grok

Rule Path
Disallow /

hugging face

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

intelliseek.ai

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

kangaroo

Rule Path
Disallow /

leftwinggpt

Rule Path
Disallow /

llama

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

meta ai

Rule Path
Disallow /

meta llama

Rule Path
Disallow /

meta.ai

Rule Path
Disallow /

meta-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

metaai

Rule Path
Disallow /

mistral

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

oai searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

open ai

Rule Path
Disallow /

openai

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rightwinggpt

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

searchgpt

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sidetrade

Rule Path
Disallow /

stability

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

webchatgpt

Rule Path
Disallow /

webzio

Rule Path
Disallow /

whisper

Rule Path
Disallow /

x.ai

Rule Path
Disallow /

xai

Rule Path
Disallow /

youbot

Rule Path
Disallow /

zero gtp

Rule Path
Disallow /

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow */comment-page-
Disallow */trackback/
Disallow */wp-*.php
Disallow */xmlrpc.php
Disallow *?comments=
Disallow *?orderby=date
Disallow *?orderby=popularity
Disallow *?orderby=price
Disallow *?orderby=price-desc
Disallow *?orderby=rating
Disallow *?replytocom
Disallow *?replytocom
Disallow *?wptheme=
Disallow /*/attachment/
Disallow /?s=
Disallow /02febrero/
Disallow /02septiembre/
Disallow /12abril/
Disallow /12enero/
Disallow /12mayo/
Disallow /14abril/
Disallow /17febrero/
Disallow /17marzo/
Disallow /17noviembre/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2012/09/
Disallow /2013/09/
Disallow /2014/12/
Disallow /2018/
Disallow /2018/03/
Disallow /2018/06/
Disallow /2018/07/
Disallow /2018/08/
Disallow /2018/09/
Disallow /2018/10/
Disallow /2018/12/
Disallow /2019/09/
Disallow /2019/10/
Disallow /2019/11/
Disallow /2020/02/
Disallow /2020/05/
Disallow /2020/08/
Disallow /2020/09/
Disallow /2020/11/
Disallow /2021/
Disallow /2021/03/
Disallow /2021/04/
Disallow /2021/05/
Disallow /2021/06/
Disallow /2021/08/
Disallow /2022/
Disallow /2022/01/
Disallow /2022/02/
Disallow /2022/03/
Disallow /2022/04/
Disallow /2022/05/
Disallow /2022/06/
Disallow /2022/08/
Disallow /2022/10/
Disallow /2022/11/
Disallow /2022/12/
Disallow /2022/page/2/
Disallow /2023/01/
Disallow /2023/02/
Disallow /2023/05/
Disallow /2023/06/
Disallow /2023/09/
Disallow /270506/
Disallow /29abril/
Disallow /30junio/
Disallow /30septiembre/
Disallow /8junio/
Disallow /adicto/
Disallow /afterhour/
Disallow /albufera/
Disallow /albuferabici/
Disallow /alfambra/
Disallow /alfonso/
Disallow /ametlla/
Disallow /ametlla02/
Disallow /ametlla03/
Disallow /amics2008/
Disallow /ampolla-calafat/
Disallow /aniversari/
Disallow /anticiclon/
Disallow /antigua/
Disallow /author/
Disallow /author/diariokayak/
Disallow /autorescate/
Disallow /aviso-legal/
Disallow /cabo-gata/
Disallow /baca/
Disallow /baixebre/
Disallow /bajadaebro/
Disallow /bautismo/
Disallow /bcn/
Disallow /bear/
Disallow /beniemocions/
Disallow /binding/
Disallow /boyas/
Disallow /buscar/
Disallow /camarasa/
Disallow /canalgaronne/
Disallow /canal-garonne/
Disallow /camping/
Disallow /categoria-producto/
Disallow /canalmidi/
Disallow /canal-midi/
Disallow /canelles/
Disallow /cantabria/
Disallow /capsalou/
Disallow /carillet2/
Disallow /carrilet1/
Disallow /carrito/
Disallow /carro/
Disallow /CatalogNumberList/
Disallow /catorcenoviembre/
Disallow /circulomercantil/
Disallow /cocina/
Disallow /color/
Disallow /comments/
Disallow /como-hacer/
Disallow /como-remar/
Disallow /constitucion/
Disallow /contacto/
Disallow /conv/
Disallow /crisis/
Disallow /cuatrofebrero/
Disallow /cuatromarzo/
Disallow /cuerno/
Disallow /curset/
Disallow /deltabici/
Disallow /deltabici/
Disallow /deltaebro/
Disallow /department/
Disallow /destino/
Disallow /diarioingles/
Disallow /docejulio/
Disallow /dragones2009dia1/
Disallow /dragones2010/
Disallow /ean/
Disallow /etiqueta-producto/
Disallow /eanlist/
Disallow /ebay/
Disallow /ebro10/
Disallow /electrica/
Disallow /eliana/
Disallow /eng/
Disallow /esquimal/
Disallow /estreno/
Disallow /estreno/
Disallow /familiaebro/
Disallow /fiesta/
Disallow /flyingpigeon/
Disallow /formentera/
Disallow /formentera-low-cost/
Disallow /friki/
Disallow /fu/
Disallow /funplay/
Disallow /fundas-estancas/
Disallow /gps/
Disallow /graduado/
Disallow /groenlandes/
Disallow /gurugu/
Disallow /halloween/
Disallow /hector/
Disallow /hombrealagua/
Disallow /illabuda/
Disallow /irta/
Disallow /itemdimensions/
Disallow /javeamoraira/
Disallow /karma/
Disallow /keeleazy/
Disallow /label/
Disallow /landas/
Disallow /laser/
Disallow /ligero/
Disallow /loriu/
Disallow /luna-llena/
Disallow /manufacturer/
Disallow /marca/
Disallow /marjal/
Disallow /marmenor01/
Disallow /marmenor02/
Disallow /master/
Disallow /medusa/
Disallow /memoria/
Disallow /menorcaa/
Disallow /menorcab/
Disallow /mi-cuenta/
Disallow /model/
Disallow /monamour/
Disallow /nadar/
Disallow /namnam/
Disallow /networka/
Disallow /nochevieja/
Disallow /nordkapp/
Disallow /nudekayak/
Disallow /NUEVEENERO/
Disallow /oasis/
Disallow /oceanduo/
Disallow /ochodemarzo/
Disallow /ojosnegros/
Disallow /ojosnegros2/
Disallow /ojosnegros3/
Disallow /oropesaalcocebre/
Disallow /oropesa-alcocebre/
Disallow /orza/
Disallow /otonal/
Disallow /packagedimensions/
Disallow /packagequantity/
Disallow /pajara/
Disallow /palolijao/
Disallow /pantano-sichar/
Disallow /parejita/
Disallow /peniscola/
Disallow /perdida/
Disallow /pinar/
Disallow /pirata/
Disallow /plastic/
Disallow /plata/
Disallow /poblamarina/
Disallow /poder/
Disallow /politica-de-cookies/
Disallow /politica-de-privacidad/
Disallow /pongatimon/
Disallow /prat/
Disallow /primavera/
Disallow /primaveraebro/
Disallow /puertas/
Disallow /puertas/
Disallow /quedadaebro/
Disallow /quedada-ebro/
Disallow /quedadas/
Disallow /rafanook/
Disallow /reflexion/
Disallow /repair_reed/
Disallow /reto/
Disallow /rina/
Disallow /rio-mijares/
Disallow /riot/
Disallow /saler/
Disallow /sansilvestre/
Disallow /santolea/
Disallow /search
Disallow /seawolf/
Disallow /seayakmango/
Disallow /semana/
Disallow /serllevado/
Disallow /serrairta/
Disallow /sirena/
Disallow /siurana/
Disallow /size/
Disallow /sm/
Disallow /social/
Disallow /sorolla/
Disallow /suscripcion/
Disallow /tabarca/
Disallow /tandembrother/
Disallow /terminos-de-uso/
Disallow /terraalta/
Disallow /tienda/
Disallow /tienda-de-kayak/
Disallow /brand/
Disallow /torredembarra/
Disallow /tortugueta/
Disallow /touringcag/
Disallow /trailer/
Disallow /trailgator/
Disallow /treceabril/
Disallow /tuneo/
Disallow /turia/
Disallow /unodemayo/
Disallow /upc/
Disallow /upclist/
Disallow /valencia/
Disallow /valzafan/
Disallow /vecinos/
Disallow /veinticincomarzo/
Disallow /veranito/
Disallow /viajar/
Disallow /viaje/
Disallow /vinaroz/
Disallow /vpc-ca65/
Disallow /vueltaibiza/
Disallow /wallpaper/
Disallow /werner/
Disallow /wp-admin/
Disallow /wp-content/languages
Disallow /wp-content/mu-plugins
Disallow /wp-content/plugins/asesor-cookies-para-la-ley-en-espana
Disallow /wp-content/plugins/broken-link-checker
Disallow /wp-content/plugins/contact-form-7
Disallow /wp-content/plugins/contact-form-submissions
Disallow /wp-content/plugins/dnui_pro
Disallow /wp-content/plugins/nofollow
Disallow /wp-content/plugins/seo-by-rank-math
Disallow /wp-content/plugins/seo-by-rank-math-pro
Disallow /wp-content/plugins/tablepress
Disallow /wp-content/plugins/wp-amp
Disallow /wp-content/plugins/wp-google-analytics-events
Disallow /wp-content/plugins/wp-rocket
Disallow /wp-content/plugins/wp-sitem
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-json/
Disallow /xerta/

Other Records

Field Value
sitemap https://www.diariodekayak.es/post-sitemap.xml
sitemap https://www.diariodekayak.es/video-sitemap.xml
sitemap https://www.diariodekayak.es/page-sitemap.xml
sitemap https://www.diariodekayak.es/category-sitemap.xml
sitemap https://www.diariodekayak.es/diariokayak.xml

Comments

  • Bloquear bots de todas las IAs
  • https://perishablepress.com/ultimate-ai-block-list/