okdiario.com
robots.txt

Robots Exclusion Standard data for okdiario.com

Resource Scan

Scan Details

Site Domain okdiario.com
Base Domain okdiario.com
Scan Status Ok
Last Scan2024-11-16T05:20:38+00:00
Next Scan 2024-11-23T05:20:38+00:00

Last Scan

Scanned2024-11-16T05:20:38+00:00
URL https://okdiario.com/robots.txt
Domain IPs 104.18.18.5, 104.18.19.5, 2606:4700::6812:1205, 2606:4700::6812:1305
Response IP 104.18.18.5
Found Yes
Hash 9cbd1256701977d9af84b64265a4ceb3a713068a9ca51292a3e61794d7c63ae3
SimHash a3d259d68eb9

Groups

*

Rule Path
Disallow /buscador/
Disallow /buscador/?q=*
Disallow /?*pid
Disallow /newsletter/
Disallow /euro-dolar/*
Disallow /bonos/*
Disallow /criptodivisas/*
Disallow /materias-primas/*
Disallow */en-la-red
Disallow /okclub/*
Disallow /okclub
Disallow /ok-vs-ko/*
Disallow /ok-vs-ko
Disallow /?attachment_id*
Disallow /?s=
Disallow /resultados/*
Disallow /guiltybit/*
Disallow /*.swf$
Disallow /*.tif$
Disallow /*.mp3$
Disallow /*.flv$
Disallow /*.mp4$
Disallow /*.avi$
Disallow /*.ics$
Disallow /*.pdf$
Disallow /*.ppt$
Disallow /*.pptx$
Disallow /*.doc$
Disallow /*.docx$

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

googlebot
googlebot-news
googlebot-image
googlebot-video

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://okdiario.com/sitemaps/okd-sitemap-google-news.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-index.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-categories-1.xml
sitemap https://okdiario.com/look/sitemap_index.xml
sitemap https://okdiario.com/look/news-sitemap.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-news-happyfm.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-news-baleares.xml
sitemap https://okdiario.com/diariomadridista/sitemap_index.xml
sitemap https://okdiario.com/diariomadridista/news-sitemap.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-author-1.xml
sitemap https://okdiario.com/sitemaps/okd-tags-sitemaps.xml
sitemap https://talent24h.okdiario.com/news-sitemap.xml

Comments

  • Directorios bloqueados
  • Extensiones de contenidos no indexables
  • Bloqueo de agentes