dataactivity.com.br
robots.txt

Robots Exclusion Standard data for dataactivity.com.br

Resource Scan

Scan Details

Site Domain dataactivity.com.br
Base Domain dataactivity.com.br
Scan Status Ok
Last Scan2025-06-07T07:05:16+00:00
Next Scan 2025-07-07T07:05:16+00:00

Last Scan

Scanned2025-06-07T07:05:16+00:00
URL https://dataactivity.com.br/robots.txt
Domain IPs 104.21.87.233, 172.67.148.106, 2606:4700:3033::6815:57e9, 2606:4700:3036::ac43:946a
Response IP 172.67.148.106
Found Yes
Hash cf464f3340387a76e7459b4872321f21a9d0d1891b47989f933788f3eaa7c27a
SimHash 4c2a4463ffd7

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /cgi-bin/
Disallow /private/
Disallow /temp/
Disallow /tmp/
Disallow /*.log$
Disallow /*.bak$
Disallow /*.old$
Disallow /*.backup$
Disallow /.htaccess
Disallow /.env
Disallow /config/
Disallow /*.ini$
Disallow /*.conf$
Disallow /*?utm_*
Disallow /*?ref=*
Disallow /*?fbclid=*
Disallow /*?gclid=*

googlebot

Rule Path
Allow /assets/css/
Allow /assets/js/
Allow /assets/images/
Allow /assets/fonts/

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /assets/css/
Allow /assets/js/
Allow /assets/images/
Allow /assets/fonts/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://dataactivity.com.br/sitemap.xml

Comments

  • ROBOTS.TXT - DATA ACTIVITY
  • Gerado em: 04/06/2025
  • Site: https://dataactivity.com.br
  • CONFIGURAÇÕES PARA TODOS OS BOTS
  • PERMITIR ACESSO GERAL
  • BLOQUEAR ÁREAS SENSÍVEIS
  • BLOQUEAR ARQUIVOS DE CONFIGURAÇÃO
  • BLOQUEAR PARÂMETROS DE URL ESPECÍFICOS
  • CONFIGURAÇÕES ESPECÍFICAS DO GOOGLEBOT
  • CONFIGURAÇÕES PARA BINGBOT
  • BLOQUEAR BOTS ESPECÍFICOS (SE NECESSÁRIO)
  • User-agent: AhrefsBot
  • Disallow: /
  • User-agent: SemrushBot
  • Disallow: /
  • User-agent: MJ12bot
  • Disallow: /
  • LOCALIZAÇÃO DO SITEMAP
  • INFORMAÇÕES ADICIONAIS
  • Site: Data Activity - Agência de Marketing Digital
  • Contato: contato@dataactivity.com.br
  • Última atualização: 04/06/2025