Log In Sign Up

novoimovel.net.br
robots.txt

Robots Exclusion Standard data for novoimovel.net.br

Resource Scan

Scan Details

Site Domain novoimovel.net.br
Base Domain novoimovel.net.br
Scan Status Ok
Last Scan2025-10-29T11:49:19+00:00
Next Scan 2025-11-28T11:49:19+00:00

Last Scan

Scanned2025-10-29T11:49:19+00:00
URL https://novoimovel.net.br/robots.txt
Domain IPs 104.21.17.171, 172.67.177.183, 2606:4700:3031::ac43:b1b7, 2606:4700:3034::6815:11ab
Response IP 172.67.177.183
Found Yes
Hash aac93558873016d96e4d49e9910dee198420939543a3afc33bb3b4a13d7869da
SimHash 291fde618673

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

slurp

Rule Path
Allow /

rsiteauditor

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

chatgpt-user/2.0

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /index
Disallow /list
Disallow /post

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://novoimovel.net.br/sitemap.xml
Back to top

Comments

  • Google e Bing
  • Bots de anúncios e análise do Google
  • Bots de redes sociais
  • Bots de análise e SEO
  • Bots OpenAI (ChatGPT e GPTBot)
  • Bloquear todos os outros bots
  • Bloquear rastreamento desnecessário
  • Configurar um crawl delay para reduzir impacto
  • Sitemap
Back to top