Log In Sign Up

robuxbazaar.com
robots.txt

Robots Exclusion Standard data for robuxbazaar.com

Resource Scan

Scan Details

Site Domain robuxbazaar.com
Base Domain robuxbazaar.com
Scan Status Ok
Last Scan2025-10-24T18:50:36+00:00
Next Scan 2025-10-31T18:50:36+00:00

Last Scan

Scanned2025-10-24T18:50:36+00:00
URL https://robuxbazaar.com/robots.txt
Domain IPs 185.215.234.3, 185.215.235.3
Response IP 185.215.235.3
Found Yes
Hash 512049c2b65ed7d4e4a6cd7c427b8f30420298c8121128327afc101757bf9b4c
SimHash 60170f52c6e3

Groups

*

Rule Path
Allow /
Allow /index.php
Allow /produtos.php
Allow /gratis.php
Disallow /admin/
Disallow /includes/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /logs/
Disallow /backup/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /*.sql$
Disallow /*.sql.gz$
Disallow /*.log$
Disallow /*.env$
Disallow /*.config$
Disallow /error_log
Disallow /error.log
Disallow /.git/
Disallow /.env
Disallow /.htaccess

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /*.png$
Allow /*.webp$

bingbot

Rule Path
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /*.png$
Allow /*.webp$

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://robuxbazaar.com/sitemap.xml
Back to top

Comments

  • Configurações globais para todos os robôs
  • Permitir acesso a todas as páginas principais
  • Direcionar os robôs para o sitemap
  • Bloquear acesso a diretórios administrativos e sensíveis
  • Regras específicas para Googlebot
  • Regras específicas para Bingbot
  • Bloquear bots maliciosos conhecidos
  • Taxa de rastreamento para evitar sobrecarga do servidor
  • Host canônico
Back to top

Warnings

  • `host` is not a known field.
Back to top