cronicabalear.es
robots.txt

Robots Exclusion Standard data for cronicabalear.es

Resource Scan

Scan Details

Site Domain cronicabalear.es
Base Domain cronicabalear.es
Scan Status Ok
Last Scan2024-11-15T02:53:54+00:00
Next Scan 2024-11-22T02:53:54+00:00

Last Scan

Scanned2024-11-15T02:53:54+00:00
URL https://cronicabalear.es/robots.txt
Redirect https://www.cronicabalear.es/robots.txt
Redirect Domain www.cronicabalear.es
Redirect Base cronicabalear.es
Domain IPs 87.106.125.37
Redirect IPs 87.106.125.37
Response IP 87.106.125.37
Found Yes
Hash a65a84338bc57570093e98d6ec9a160d85525bfec630790db67818a72e367c62
SimHash c816ded0526f

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /junk/
Allow /

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seolyzer

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

Comments

  • robots.txt generado por YAGLE AGENCY
  • FASE 2.0 (2024-05-22)
  • Permitir a Googlebot acceso completo sin retraso de rastreo
  • Rastreador de Bing
  • Rastreador de Yahoo
  • Rastreador de Facebook!
  • Aplicar retraso de rastreo para todos los demás bots
  • Bloquear bots específicos