Log In Sign Up

caustica.co
robots.txt

Robots Exclusion Standard data for caustica.co

Resource Scan

Scan Details

Site Domain caustica.co
Base Domain caustica.co
Scan Status Ok
Last Scan2024-06-25T16:13:12+00:00
Next Scan 2024-07-02T16:13:12+00:00

Last Scan

Scanned2024-06-25T16:13:12+00:00
URL https://caustica.co/robots.txt
Redirect https://caustica.eltiempo.com/robots.txt
Redirect Domain caustica.eltiempo.com
Redirect Base eltiempo.com
Domain IPs 172.200.168.128
Redirect IPs 45.60.125.135
Response IP 45.60.125.135
Found Yes
Hash 39f823aceb016de4a79cf20854277f4b3a0dfd0b19cadd31778f154a86e549c4
SimHash d45a111eaf30

Groups

*

Rule Path
Disallow /nogooglebot/
Disallow /_next/static/

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

news-please

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://caustica.eltiempo.com/api/sitemap.xml
sitemap https://caustica.eltiempo.com/api/sitemap-articles-current.xml
sitemap https://caustica.eltiempo.com/api/sitemap-google-news.xml
sitemap https://caustica.eltiempo.com/api/sitemap-images-index.xml
sitemap https://caustica.eltiempo.com/api/sitemap-google-video.xml
Back to top

Comments

  • Specific robot directives / Directivas específicas para robots:
  • Casa Editorial El Tiempo content is made available under our terms and conditions; for personal, non-commercial use / El contenido de Casa Editorial El Tiempo está disponible bajo nuestros términos y condiciones; para uso personal, no comercial;
  • To our Terms of Service here: https://www.eltiempo.com/terminos-condiciones/ / Consultar nuestros Términos y Condiciones de Servicio aquí: https://www.eltiempo.com/terminos-condicioneshttps://www.eltiempo.com/terminos-condiciones/
  • Use of any device, tool, or process designed to data mine or scrape the content, using automated means, it is prohibited without prior written permission from Casa Editorial El Tiempo / El uso de cualquier dispositivo, herramienta o proceso diseñado para extraer datos o raspar el contenido, utilizando medios automatizados, está prohibido sin el permiso previo por escrito de Casa Editorial El Tiempo.
  • Prohibited uses include but are not limited to: / Los usos prohibidos del contenido incluyen, entre otros:
  • (1) text and data mining activities; / (1) actividades de minería de textos y datos;
  • (2) the development of any software, machine learning, artificial intelligence (AI), and/or large language models (LLMs); / (2) el desarrollo de cualquier software, aprendizaje automático, inteligencia artificial (IA) y/o grandes modelos de lenguaje (LLM);
  • (3) creating or providing archived or cached data sets containing our content to others; and/or / (3) crear o proporcionar conjuntos de datos archivados o en caché que contengan nuestro contenido a otros; y/o
  • (4) any commercial purposes / (4) cualquier propósito comercial.
  • Contact for assistance: notificaciones@eltiempo.com / Contacto para asistencia: notificaciones@eltiempo.com
Back to top

Warnings

  • 1 invalid line.
Back to top