Log In Sign Up

mindies.es
robots.txt

Robots Exclusion Standard data for mindies.es

Resource Scan

Scan Details

Site Domain mindies.es
Base Domain mindies.es
Scan Status Ok
Last Scan2025-12-02T02:19:44+00:00
Next Scan 2025-12-09T02:19:44+00:00

Last Scan

Scanned2025-12-02T02:19:44+00:00
URL https://mindies.es/robots.txt
Domain IPs 2a02:4780:16:c921:145c:6de1:dcaf:b051, 2a02:4780:38:43d3:19ae:3ea3:81e9:83f8, 84.32.84.207, 84.32.84.77
Response IP 91.108.100.235
Found Yes
Hash 1bcf43b55bb038174343322301f2c3711a923552df8d5a2b4baf95fbcd16b87a
SimHash 69104480cdba

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /z/j/
Disallow /z/c/
Disallow /stats/
Disallow /dh_
Disallow /manual/
Disallow /phpmanual/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-json/
Disallow /trackback/
Disallow /comments/feed/
Disallow /xmlrpc.php
Disallow /*?*

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.mindies.es/sitemap_index.xml
sitemap https://www.mindies.es/sitemap-news.xml
Back to top

Comments

  • Bloqueo general de carpetas no públicas
  • Disallow: /about/
  • Disallow: /contact/
  • Disallow: /contact/
  • Disallow: /category/
  • Disallow: /tag/
  • Bloqueo de contenidos pesados o poco útiles para rastreo
  • Disallow: /wp-content/uploads/
  • Disallow: /feed/
  • Disallow: /rss
  • Bloqueo de URLs con parámetros
  • Corrección: eliminar línea inválida
  • (Eliminada línea: Disallow: /“http://127.0.0.1”)
  • Bloqueo de rastreadores poco útiles
  • User-agent: duggmirror
  • Disallow: /
  • User-agent: bingbot
  • Disallow: /
  • User-agent: facebookexternalhit
  • Allow: /
  • User-agent: Twitterbot
  • Allow: /
  • User-agent: coccocbot
  • Disallow: /
  • User-agent: Paqlebot
  • Disallow: /
  • User-agent: MJ12bot
  • Disallow: /
  • User-agent: DotBot
  • Disallow: /
  • User-agent: Seekport Crawler
  • Disallow: /
  • User-agent: crawler_eb_germany_2.0
  • Disallow: /
  • User-agent: AhrefsBot
  • Disallow: /
  • User-agent: SemrushBot
  • Disallow: /
  • Permitir bots útiles
  • User-agent: Googlebot-Image
  • Disallow:
  • Allow: /*
  • User-agent: Mediapartners-Google*
  • Disallow:
  • Allow: /*
  • Googlebot: bloquear archivos pesados e innecesarios
  • User-agent: Googlebot
  • Disallow: /*.php$
  • Disallow: /*.js$
  • Disallow: /*.inc$
  • Disallow: /*.css$
  • Disallow: /*.gz$
  • Disallow: /*.wmv$
  • Disallow: /*.cgi$
  • Disallow: /*.xhtml$
  • Disallow: /wp-content/uploads/
  • Disallow: /feed/
  • Disallow: /rss
  • Disallow: /wp-json/
  • Disallow: /*?*
Back to top