Log In Sign Up

cliqueimudei.com
robots.txt

Robots Exclusion Standard data for cliqueimudei.com

Resource Scan

Scan Details

Site Domain cliqueimudei.com
Base Domain cliqueimudei.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-25T06:11:01+00:00
Next Scan 2026-03-27T06:11:01+00:00

Last Successful Scan

Scanned2026-01-04T06:04:37+00:00
URL https://cliqueimudei.com/robots.txt
Domain IPs 104.26.8.42, 104.26.9.42, 172.67.69.105, 2606:4700:20::681a:82a, 2606:4700:20::681a:92a, 2606:4700:20::ac43:4569
Response IP 172.67.69.105
Found Yes
Hash fe9a6467041bc980effdf845683c1e5d2af917973b481069f266e062f7731ec5
SimHash ea5d5c914617

Groups

*

Rule Path
Allow /
Disallow /perfil/
Disallow /admin/
Disallow /dashboard/
Disallow /minha-conta/
Disallow /api/
Disallow /_next/
Disallow /static/
Disallow /*.json$
Disallow /*?*pagina=1%5B1-9%5D
Disallow /*?*pagina=2
Disallow /*?*pagina=3
Disallow /*?*pagina=4
Disallow /*?*pagina=5
Disallow /*?*&*&*&
Disallow /*?*quartos*&*banheiros*&*vagas*
Disallow /*?*ordenar=
Disallow /*?*sort=
Disallow /*?*order=
Disallow /*?*preco_min=
Disallow /*?*preco_max=
Disallow /*?*area_min=
Disallow /*?*area_max=
Allow /sitemap*.xml
Allow /api/sitemap*

googlebot

Rule Path
Allow /
Allow /_next/static/

Other Records

Field Value
crawl-delay 0.5

googlebot-image

Rule Path
Allow /
Allow /assets/
Disallow /perfil/
Disallow /admin/

bingbot

Rule Path
Allow /
Allow /_next/static/

Other Records

Field Value
crawl-delay 0.5

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://cliqueimudei.com/sitemap.xml
sitemap https://cliqueimudei.com/api/sitemap-index.xml
Back to top

Comments

  • Robots.txt - CliqueiMudei
  • Otimizado para crawl budget eficiente
  • Última atualização: 2025-12-11
  • ===== PÁGINAS ADMINISTRATIVAS E PRIVADAS =====
  • ===== RECURSOS TÉCNICOS =====
  • ===== OTIMIZAÇÃO DE CRAWL BUDGET =====
  • Bloquear paginação profunda (páginas 11+)
  • Bloquear combinações complexas de filtros (3+ parâmetros)
  • Bloquear buscas por ordenação (não adiciona valor SEO)
  • Bloquear filtros de preço específicos (muito granular)
  • ===== PERMITIR SITEMAPS =====
  • ===== SITEMAPS =====
  • ===== REGRAS ESPECÍFICAS PARA GOOGLEBOT =====
  • Permitir crawling mais agressivo para principais páginas
  • Permitir JavaScript rendering
  • Permitir imagens de assets
  • ===== REGRAS ESPECÍFICAS PARA BINGBOT =====
  • ===== OUTROS BOTS DE BUSCA =====
  • ===== BOTS DE REDES SOCIAIS (para preview de links) =====
  • ===== BOTS PROBLEMÁTICOS =====
  • Bloquear bots que consomem muito crawl budget sem valor
Back to top