folhabv.com.br
robots.txt

Robots Exclusion Standard data for folhabv.com.br

Resource Scan

Scan Details

Site Domain folhabv.com.br
Base Domain folhabv.com.br
Scan Status Ok
Last Scan2026-03-15T04:16:26+00:00
Next Scan 2026-03-22T04:16:26+00:00

Last Scan

Scanned2026-03-15T04:16:26+00:00
URL https://folhabv.com.br/robots.txt
Redirect https://www.folhabv.com.br/robots.txt
Redirect Domain www.folhabv.com.br
Redirect Base folhabv.com.br
Domain IPs 104.26.10.50, 104.26.11.50, 172.67.70.64, 2606:4700:20::681a:a32, 2606:4700:20::681a:b32, 2606:4700:20::ac43:4640
Redirect IPs 104.26.10.50, 104.26.11.50, 172.67.70.64, 2606:4700:20::681a:a32, 2606:4700:20::681a:b32, 2606:4700:20::ac43:4640
Response IP 104.26.10.50
Found Yes
Hash afd61a420edb13012b6aa7a3fc549ba98d13271925881bd0893849f3e3f646da
SimHash 7e3a0940a61a

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /?s=
Disallow /search
Disallow /trackback/
Disallow /readme.html
Disallow /license.txt
Disallow /cdn-cgi/
Disallow /private/

ccbot
perplexitybot
anthropic-ai
claudebot
omgilibot
diffbot
applebot-extended

Rule Path
Disallow /

amazonbot
petalbot
semrushbot
semrushbot-sa
bytespider
seobilitybot
ahrefsbot
blexbot
dotbot
linkdexbot
scrapy
yandexbot
baiduspider
sogou
mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://A seguinte extensão PHP está faltando: dom. Entre em contato com o seu host para concluir a instalação.
sitemap https://A seguinte extensão PHP está faltando: dom. Entre em contato com o seu host para concluir a instalação.

Comments

  • robots.txt – SEOX / Publisher - 2026-01
  • ------------------------------------------------------------------
  • BLOQUEIO GERAL & ROTAS ADMINISTRATIVAS
  • ------------------------------------------------------------------
  • ------------------------------------------------------------------
  • AI CRAWLERS & LLM SCRAPERS
  • ------------------------------------------------------------------
  • ------------------------------------------------------------------
  • SEO / SCRAPING BOTS AGRESSIVOS
  • ------------------------------------------------------------------
  • ------------------------------------------------------------------
  • SITEMAPS
  • ------------------------------------------------------------------

Warnings

  • `as seguintes classes php estã£o faltando` is not a known field.
  • `https` is not a known field.