dynos.es
robots.txt

Robots Exclusion Standard data for dynos.es

Resource Scan

Scan Details

Site Domain dynos.es
Base Domain dynos.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-18T02:40:18+00:00
Next Scan 2024-08-16T02:40:18+00:00

Last Successful Scan

Scanned2023-04-01T22:59:29+00:00
URL https://dynos.es/robots.txt
Redirect https://www.dynos.es/robots.txt
Redirect Domain www.dynos.es
Redirect Base dynos.es
Domain IPs 104.26.14.162, 104.26.15.162, 172.67.68.59, 2606:4700:20::681a:ea2, 2606:4700:20::681a:fa2, 2606:4700:20::ac43:443b
Redirect IPs 104.26.14.162, 104.26.15.162, 172.67.68.59, 2606:4700:20::681a:ea2, 2606:4700:20::681a:fa2, 2606:4700:20::ac43:443b
Response IP 172.67.68.59
Found Yes
Hash 108682ff2a9975f01318b5e6ba5a7038ed51c668ab30ea7d8ef19006e0afb2f0
SimHash 7702c17299b3

Groups

*

Rule Path
Disallow */login
Disallow */cart/
Disallow */cart$
Disallow */user
Disallow */account
Disallow */private
Disallow */logout
Disallow */task
Disallow */tasks
Disallow /search?q=*
Disallow /*?order=*
Disallow /*?cat=*
Disallow /*?*quality=*
Disallow /aviso-legal
Disallow /condiciones-generales
Disallow /politica-cookies
Disallow /*/*/*/*
Allow /*/*/*/*.jpg
Allow /*/*/*/*.png
Disallow /*?pagina=0
Disallow /*?pagina=1$
Disallow /shop-dynos/details/
Disallow /tiendas/provincias/index.asp?provincia=*
Disallow *?fab=*
Disallow *?provincia=*
Disallow /inc/form_reservar.php*
Disallow *?key=*
Disallow *%26key%3D*
Disallow *?rango_precios=*
Disallow *?grid=*
Disallow *%26grid%3D*
Disallow *?orden=*
Disallow *%26orden%3D*
Disallow *?keepThis=*
Disallow *%26keepThis%3D*
Disallow *?cod_articulo=*
Disallow *%26cod_articulo%3D*
Disallow /calcular_portes.php?cod=*
Disallow /search.html?pag=*
Disallow *?cap=*
Disallow *?params=*
Disallow /inc/form_reservar.php?cod_art=*
Disallow *?art=*
Disallow *?cap=*
Disallow *?cualid=*
Disallow *?cat=*
Disallow *?quality=*
Disallow *?fab=*
Disallow */support/customer?cod_articulo=*

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

black hole

Rule Path
Disallow /

xenu\\\'s link sleuth 1.1c

Rule Path
Disallow /

xenu\\\'s

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dynos.es/sitemap.xml

Comments

  • SITEMAP INDEX
  • PRIVATE URLS
  • QUERIES
  • CORPORATIVE URLS
  • Blocked Urls filters
  • Blocked Urls pagination
  • Incluidas por recomendación de ID
  • Disallow: *?catchment=*
  • Bot configuration
  • User-agent: Googlebot
  • Disallow:
  • User-agent: Googlebot-image
  • Disallow:
  • Blocked Bad Bots

Warnings

  • 1 invalid line.