testecs.vip
robots.txt

Robots Exclusion Standard data for testecs.vip

Resource Scan

Scan Details

Site Domain testecs.vip
Base Domain testecs.vip
Scan Status Ok
Last Scan2025-09-17T02:17:53+00:00
Next Scan 2025-10-17T02:17:53+00:00

Last Scan

Scanned2025-09-17T02:17:53+00:00
URL https://testecs.vip/robots.txt
Domain IPs 82.221.136.47
Response IP 82.221.136.47
Found Yes
Hash 439942572137054f1714d75a7b45bf838163bffd9f2cb4682c482375ece6abbd
SimHash 6a3e581342c6

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-includes/js/
Allow /wp-content/themes/
Allow *.css
Allow *.js
Allow *.png
Allow *.jpg
Allow *.jpeg
Allow *.gif
Allow *.svg
Allow *.webp
Allow *.pdf
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /license.txt
Disallow /wp-login.php
Disallow /loja/
Disallow /carrinho/
Disallow /cart/
Disallow /checkout/
Disallow /finalizar-compra/
Disallow /minha-conta/
Disallow /my-account/
Disallow /conta/
Disallow /verificacao-de-e-mail/
Disallow /search
Disallow /?s=
Disallow /page/
Disallow /pagina/
Disallow /?paged=
Disallow /*/page/
Disallow /*?page=
Disallow /feed/
Disallow /comments/feed/
Disallow /rss
Disallow /rss2
Disallow /*/feed/
Disallow /author/
Disallow /*?replytocom
Disallow /*?orderby=
Disallow /*?filter_
Disallow /*?utm_
Disallow /*?fbclid=
Disallow /*?gclid=
Disallow /*?ref=
Disallow /*?session=
Disallow /*?add-to-cart=
Disallow /*%26amp%3B
Disallow */?add_to_wishlist=*
Disallow */?max_price*
Disallow */?min_price*
Disallow */politica-de-privacidade/*
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$
Disallow /*.zip$
Disallow /*.old$
Disallow /cgi-bin/
Disallow /wp-json/
Disallow /trackback/
Disallow /?rest_route=
Disallow /*.php$
Disallow /*.cgi$
Disallow /*.inc$
Disallow /*.xhtml$

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Allow /wp-content/uploads/
Allow /wp-content/uploads/*
Allow /wp-content/themes/
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-*.webp
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Allow /wp-admin/admin-ajax.php

rogerbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

dotbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

wayback

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

googleother-image

Rule Path
Disallow /

googleother-video

Rule Path
Disallow /

gemini-deep-research

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

andibot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bedrockbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mistralai-user

Rule Path
Disallow /

mistralai-user/1.0

Rule Path
Disallow /

youbot

Rule Path
Disallow /

phindbot

Rule Path
Disallow /

quillbot

Rule Path
Disallow /

quillbot.com

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

httrack

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

java

Rule Path
Disallow /

jakarta

Rule Path
Disallow /

Other Records

Field Value
sitemap https://testecs.vip/sitemap_index.xml

Comments

  • 🤖 ROBOTS.TXT OTIMIZADO - PrevenFire Brasil
  • Última atualização: Agosto 2025
  • Foco: SEO, Segurança, Anti-IA/Scraping
  • ==========================================
  • 📋 REGRAS GERAIS PARA TODOS OS BOTS
  • ==========================================
  • ✅ RECURSOS ESSENCIAIS - Sempre permitidos
  • 🚫 WORDPRESS - Diretórios e arquivos sensíveis
  • 🚫 ECOMMERCE - Páginas privadas e checkout
  • 🚫 CONTEÚDO DUPLICADO - URLs problemáticas
  • 🚫 PARÂMETROS - Evita URLs duplicadas
  • 🚫 ARQUIVOS SENSÍVEIS - Segurança
  • ==========================================
  • 🔍 BOTS DE SEO - Configurações específicas
  • ==========================================
  • ✅ GOOGLEBOT - Recursos críticos sempre permitidos
  • ⚖️ FERRAMENTAS SEO - Configuração estratégica balanceada
  • Permite análise própria + Proteção seletiva da concorrência
  • ✅ MOZ - Permitido (menos usado pela concorrência)
  • ✅ AHREFS - Permitido com delay alto (essencial para backlinks)
  • 🚫 SEMRUSH - Bloqueado (muito popular entre concorrentes)
  • ==========================================
  • 🚫 BOTS COMERCIAIS E SCRAPERS
  • ==========================================
  • Bots de scraping comercial agressivo
  • Bots de agregação de conteúdo
  • ==========================================
  • 🤖 BOTS DE IA - Bloqueio completo
  • ==========================================
  • OpenAI
  • Anthropic (Claude)
  • Google AI
  • Meta/Facebook AI
  • Outros bots de IA
  • ==========================================
  • 🚫 SCRAPERS MALICIOSOS
  • ==========================================
  • ==========================================
  • 🗺️ SITEMAP
  • ==========================================
  • ==========================================
  • 📝 CONFIGURAÇÃO FINAL - Estratégia Balanceada
  • ==========================================
  • ✅ PERMITIDOS (para suas análises):
  • - MOZ (rogerbot/dotbot): Crawl-delay 5s - menos usado pela concorrência
  • - AHREFS: Crawl-delay 10s - essencial para backlinks, delay protege servidor
  • 🚫 BLOQUEADOS (proteção competitiva):
  • - SEMRUSH: Mais popular entre concorrentes, dados estratégicos protegidos
  • - TODOS OS BOTS DE IA: Proteção completa do conteúdo
  • RESULTADO: 70% das suas análises mantidas + proteção da ferramenta mais usada
  • IMPACTO GOOGLE: Zero - apenas ferramentas de análise, não afeta ranqueamento