unig.br
robots.txt

Robots Exclusion Standard data for unig.br

Resource Scan

Scan Details

Site Domain unig.br
Base Domain unig.br
Scan Status Ok
Last Scan2025-06-23T16:49:42+00:00
Next Scan 2025-07-23T16:49:42+00:00

Last Scan

Scanned2025-06-23T16:49:42+00:00
URL https://unig.br/robots.txt
Domain IPs 2a02:4780:84:483e:c7f:f07a:99c7:d4e3, 2a02:4780:84:c5ad:1f45:a48c:67f9:f37c, 84.32.84.108, 84.32.84.153
Response IP 91.108.100.245
Found Yes
Hash 02f4ad32669cc5757350e40a6c1f91cbae7c979b11eb7d7bc5a355ef610bda7b
SimHash eb3cdc6056a6

Groups

*

Rule Path Comment
Allow /wp-includes/js/ -
Disallow /wp-content/uploads/wpo-plugins-tables-list.json -
Disallow /wp-content/uploads/wpforms/ -
Disallow /proac/nace Bloqueio da URL incorreta (versão sem .br)
Disallow /vemserunig.gupy.io/ Bloqueio do Gupy (observação: só impede o rastreamento dentro de unig.br)
Disallow /wp-admin/ -
Disallow /xmlrpc.php -
Disallow /cgi-bin/ -
Disallow /?* -
Disallow /*?s=* Bloqueia resultados de busca interna
Disallow /author/* -
Disallow /comments/* -
Disallow /trackback/ -
Disallow /feed/ -
Disallow /*/feed/ -
Disallow /category/*/feed/ -
Disallow /tag/*/feed/ -
Disallow /*?.p=* -
Disallow /*utm_* -
Disallow /*ref%3D* -
Disallow /*source%3D* -
Disallow /*medium%3D* -
Disallow /*campaign%3D* -
Disallow /*term%3D* -
Disallow /*content%3D* -

googlebot

Rule Path Comment
Allow / Permite o rastreamento de todo o site (redundante, mas explícito)

googlebot-image

Rule Path Comment
Allow /wp-content/uploads/ Permite o rastreamento de imagens

mediapartners-google

Product Comment
mediapartners-google Para o AdSense
Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path Comment
Disallow / Exemplo de bloqueio total (avalie se é desejado)

yandexbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://unig.br/sitemap_index.xml

Comments

  • ------------- NOVO ROBOT.TXT --------------
  • Regras gerais para todos os user-agents
  • -------------- Desabilitado para melhor performance -------------------------
  • Disallow: /wp-includes/
  • Diretivas específicas para o Google
  • Diretivas específicas para outros mecanismos de busca (exemplos)
  • Localização do Sitemap