Log In Sign Up

declarando.es
robots.txt

Robots Exclusion Standard data for declarando.es

Resource Scan

Scan Details

Site Domain declarando.es
Base Domain declarando.es
Scan Status Ok
Last Scan2025-12-23T07:14:50+00:00
Next Scan 2026-01-22T07:14:50+00:00

Last Scan

Scanned2025-12-23T07:14:50+00:00
URL https://declarando.es/robots.txt
Domain IPs 104.26.10.196, 104.26.11.196, 172.67.74.119, 2606:4700:20::681a:ac4, 2606:4700:20::681a:bc4, 2606:4700:20::ac43:4a77
Response IP 172.67.74.119
Found Yes
Hash ca07f6bbf3019272a4dc6b5977fed6f7785b9f0a8f86abcc6346bbd979c1d1d7
SimHash e2a65a508e86

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /xmlrpc.php
Disallow /wp-snapshots
Disallow /cgi-bin
Disallow /comments/
Disallow /*/attachment/
Disallow /?attachment_id*
Disallow /tag/*/feed/
Disallow /tag/*/page/
Disallow /*trackback
Disallow /?s=
Disallow /search
Allow /feed/$
Disallow /*feed
Allow /*.css$
Allow /*.js$

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

ccbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://declarando.es/sitemap_index.xml
sitemap https://declarando.es/category-sitemap.xml
sitemap https://declarando.es/page-sitemap.xml
sitemap https://declarando.es/post-sitemap.xml
Back to top

Comments

  • robots.txt — https://declarando.es/ (AEO-ready, 2025-09-18)
  • 1) Reglas generales (Search)
  • Núcleo WP
  • Thin/ruido
  • Búsquedas internas
  • Feeds (solo raíz)
  • Recursos (evita bloqueos de render)
  • 2) LLM / Answer Engines
  • OpenAI (entrenamiento)
  • OpenAI (búsqueda bajo demanda desde ChatGPT)
  • Anthropic (entrenamiento/browsing)
  • Perplexity (AI search)
  • Perplexity puede ser intenso: si notas carga, puedes limitar:
  • Crawl-delay: 5
  • Common Crawl (base usada por varios LLMs)
  • CCBot respeta Crawl-delay:
  • Crawl-delay: 2
  • 3) Sitemaps
Back to top