mediabask.eus
robots.txt

Robots Exclusion Standard data for mediabask.eus

Resource Scan

Scan Details

Site Domain mediabask.eus
Base Domain mediabask.eus
Scan Status Ok
Last Scan2024-11-15T21:54:37+00:00
Next Scan 2024-11-22T21:54:37+00:00

Last Scan

Scanned2024-11-15T21:54:37+00:00
URL https://mediabask.eus/robots.txt
Redirect https://www.mediabask.eus/robots.txt
Redirect Domain www.mediabask.eus
Redirect Base mediabask.eus
Domain IPs 165.22.199.158
Redirect IPs 165.22.199.158
Response IP 165.22.199.158
Found Yes
Hash 12ccf0648d56d04e47da58a5266e6591b7f63ba60f5c3e57cae3fe546ab23d50
SimHash 8a7b5882ceb0

Groups

*

Rule Path
Disallow /en/print_send
Disallow /es/print_send
Disallow /eu/print_send
Disallow /fr/print_send
Disallow /en/visits
Disallow /es/visits
Disallow /eu/visits
Disallow /fr/visits
Disallow /en/suscripcion/entrar
Disallow /en/suscripcion/registro
Disallow /en/suscripcion/salir
Disallow /es/suscripcion/entrar
Disallow /es/suscripcion/registro
Disallow /es/suscripcion/salir
Disallow /eu/suscripcion/entrar
Disallow /eu/suscripcion/registro
Disallow /eu/suscripcion/salir
Disallow /fr/suscripcion/entrar
Disallow /fr/suscripcion/registro
Disallow /fr/suscripcion/salir
Disallow /en/eguraldia/day_detail
Disallow /es/eguraldia/day_detail
Disallow /eu/eguraldia/day_detail
Disallow /fr/eguraldia/day_detail
Disallow */comments?comment
Disallow /en/info/busqueda
Disallow /es/info/busqueda
Disallow /eu/info/busqueda
Disallow /fr/info/busqueda
Disallow /en/ajax
Disallow /es/ajax
Disallow /eu/ajax
Disallow /fr/ajax
Disallow /en/change_locale
Disallow /es/change_locale
Disallow /eu/change_locale
Disallow /fr/change_locale

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

um-ln

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

mauibot (crawler.feedback+dc@gmail.com)

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /