Log In Sign Up

civitfun.com
robots.txt

Robots Exclusion Standard data for civitfun.com

Resource Scan

Scan Details

Site Domain civitfun.com
Base Domain civitfun.com
Scan Status Ok
Last Scan2026-01-11T01:46:35+00:00
Next Scan 2026-02-10T01:46:35+00:00

Last Scan

Scanned2026-01-11T01:46:35+00:00
URL https://civitfun.com/robots.txt
Redirect https://www.civitfun.com/robots.txt
Redirect Domain www.civitfun.com
Redirect Base civitfun.com
Domain IPs 149.202.105.228
Redirect IPs 149.202.105.228
Response IP 149.202.105.228
Found Yes
Hash ac5f1b3ff4cc816908af5aa8ce1f6b92503194c4c7603381850085b9bbe83dda
SimHash c81cdfd0566f

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /junk/
Allow /

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seolyzer

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.civitfun.com/sitemap_es.xml
sitemap https://www.civitfun.com/sitemap_en.xml
Back to top

Comments

  • robots.txt generado por YAGLE AGENCY
  • FASE 2.0 (2024-05-22)
  • Permitir a Googlebot acceso completo sin retraso de rastreo
  • Aplicar retraso de rastreo para todos los demás bots
  • Bloquear bots específicos
  • Ubicación de los sitemaps
Back to top