blogs.okdiario.com
robots.txt

Robots Exclusion Standard data for blogs.okdiario.com

Resource Scan

Scan Details

Site Domain blogs.okdiario.com
Base Domain okdiario.com
Scan Status Ok
Last Scan2024-11-12T03:13:18+00:00
Next Scan 2024-12-12T03:13:18+00:00

Last Scan

Scanned2024-11-12T03:13:18+00:00
URL http://blogs.okdiario.com/robots.txt
Redirect https://okdiario.com/robots.txt
Redirect Domain okdiario.com
Redirect Base okdiario.com
Domain IPs 185.104.133.10, 185.104.133.11, 185.104.133.8, 185.104.133.9, 185.47.12.150, 185.47.12.151, 185.47.12.153, 185.47.12.155, 2a00:de40:10:333::10, 2a00:de40:10:333::11, 2a00:de40:10:333::8, 2a00:de40:10:333::9
Redirect IPs 104.18.18.5, 104.18.19.5, 2606:4700::6812:1205, 2606:4700::6812:1305
Response IP 104.18.19.5
Found Yes
Hash 9f7c992cbfe7f96fa43f4922603d5e0b6e26720a0e3a9888f52a8dc01fa39f44
SimHash a2d2599eaeb9

Groups

*

Rule Path
Disallow /buscador/
Disallow /buscador/?q=*
Disallow /?*pid
Disallow /newsletter/
Disallow /euro-dolar/*
Disallow /bonos/*
Disallow /criptodivisas/*
Disallow /materias-primas/*
Disallow */en-la-red
Disallow /okclub/*
Disallow /okclub
Disallow /ok-vs-ko/*
Disallow /ok-vs-ko
Disallow /?attachment_id*
Disallow /?s=
Disallow /resultados/*
Disallow /guiltybit/*
Disallow /*.swf$
Disallow /*.tif$
Disallow /*.mp3$
Disallow /*.flv$
Disallow /*.mp4$
Disallow /*.avi$
Disallow /*.ics$
Disallow /*.pdf$
Disallow /*.ppt$
Disallow /*.pptx$
Disallow /*.doc$
Disallow /*.docx$

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

googlebot
googlebot-news
googlebot-image
googlebot-video

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://okdiario.com/sitemaps/okd-sitemap-google-news.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-index.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-categories-1.xml
sitemap https://okdiario.com/look/sitemap_index.xml
sitemap https://okdiario.com/look/news-sitemap.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-news-happyfm.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-news-baleares.xml
sitemap https://okdiario.com/diariomadridista/sitemap_index.xml
sitemap https://okdiario.com/diariomadridista/news-sitemap.xml
sitemap https://okdiario.com/sitemaps/okd-sitemap-author-1.xml
sitemap https://okdiario.com/sitemaps/okd-tags-sitemaps.xml
sitemap https://talent24h.okdiario.com/news-sitemap.xml

Comments

  • Directorios bloqueados
  • Extensiones de contenidos no indexables
  • Bloqueo de agentes