topstudios.com.br
robots.txt

Robots Exclusion Standard data for topstudios.com.br

Resource Scan

Scan Details

Site Domain topstudios.com.br
Base Domain topstudios.com.br
Scan Status Ok
Last Scan2026-01-11T05:58:05+00:00
Next Scan 2026-01-18T05:58:05+00:00

Last Scan

Scanned2026-01-11T05:58:05+00:00
URL https://topstudios.com.br/robots.txt
Redirect https://www.topstudios.com.br/robots.txt
Redirect Domain www.topstudios.com.br
Redirect Base topstudios.com.br
Domain IPs 104.21.56.147, 172.67.152.187, 2606:4700:3036::ac43:98bb, 2606:4700:3037::6815:3893
Redirect IPs 216.198.79.65, 64.29.17.65
Response IP 216.198.79.65
Found Yes
Hash c4d17d18bbbdd635e383205011f575688425d2edc56005c9040c6771cffcbc68
SimHash c8154e30e680

Groups

*

Rule Path
Allow /
Allow /blog
Allow /blog/
Allow /blog/categoria
Allow /professional_search
Allow /profile_professional_search/
Disallow /api/
Disallow /_next/
Disallow /admin/
Disallow /mylink/
Disallow /resetpassword
Disallow /.well-known/
Disallow /404
Disallow /500
Disallow /login
Disallow /signup

googlebot

Rule Path
Allow /
Allow /blog
Allow /professional_search

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://topstudios.com.br/sitemap.xml

Comments

  • Bloquear páginas sensíveis e administrativas
  • Permitir para bots específicos importantes
  • Bloquear bots problemáticos que consomem muito crawl budget
  • Sitemap
  • Crawl delay para não sobrecarregar o servidor