creactivitat.com
robots.txt

Robots Exclusion Standard data for creactivitat.com

Resource Scan

Scan Details

Site Domain creactivitat.com
Base Domain creactivitat.com
Scan Status Ok
Last Scan2026-01-29T20:01:10+00:00
Next Scan 2026-02-28T20:01:10+00:00

Last Scan

Scanned2026-01-29T20:01:10+00:00
URL https://creactivitat.com/robots.txt
Domain IPs 104.21.27.52, 172.67.141.115, 2606:4700:3031::6815:1b34, 2606:4700:3037::ac43:8d73
Response IP 172.67.141.115
Found Yes
Hash 6f86593dd53f8fe4f5f4b3351cbaec663d5fd41747c05689d4400687aa8fb03c
SimHash 0f25c9e2663b

Groups

*

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /politica-de-privacidad/
Disallow /politica-de-privadesa/
Disallow /avisos-legales/
Disallow /avisos-legals/
Disallow /politica-de-cookies/
Disallow /gracias/
Disallow /thank-you/
Disallow /404/
Disallow /privacy-policy/
Disallow /feed/
Disallow /off-zoo/page/
Disallow /embed/
Disallow /wp-json/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /comments/
Disallow /readme.html
Disallow /license.txt
Disallow /error_log
Disallow /wp-content/cache/
Disallow /*?utm_
Disallow /*%26utm_
Disallow /*?gclid=
Disallow /*%26gclid%3D
Disallow /*?fbclid=
Disallow /*%26fbclid%3D
Disallow /*?msclkid=
Disallow /*%26msclkid%3D
Disallow /*?s=
Disallow /*%26s%3D
Disallow /*?replytocom
Disallow /*?preview=
Disallow /*?lang=
Disallow /*?preview=true
Disallow /*?preview_id=
Disallow /*?preview_nonce=
Disallow /*?customize_changeset_uuid=
Disallow /*?ver=
Disallow /llms.txt

gptbot

Rule Path
Allow /llms.txt

oai-searchbot

Rule Path
Allow /llms.txt

claudebot

Rule Path
Allow /llms.txt

perplexitybot

Rule Path
Allow /llms.txt

perplexity-user

Rule Path
Allow /llms.txt

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

archive.org_bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

webcopier

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.creactivitat.com/sitemap_index.xml

Comments

  • CREACTIVITAT - robots.txt
  • ---------------------------------------------------------------------
  • C R E A C T I V I T A T · +DE 25 ANYS COM AGENCIA DIGITAL
  • ========================================
  • CONFIGURACION GENERAL
  • ========================================
  • ========================================
  • PAGINAS
  • ========================================
  • Archivos y endpoints
  • ========================================
  • WORDPRESS CORE
  • ========================================
  • Cachés y carpetas técnicas
  • ========================================
  • PARAMETROS Y DUPLICIDADES
  • ========================================
  • ========================================
  • LLMS
  • ========================================
  • ========================================
  • BOTS ESPECIFICOS / CONTROL DE CRAWL
  • ========================================
  • ========================================
  • SITEMAP
  • ========================================