portaldoholanda.com.br
robots.txt

Robots Exclusion Standard data for portaldoholanda.com.br

Resource Scan

Scan Details

Site Domain portaldoholanda.com.br
Base Domain portaldoholanda.com.br
Scan Status Ok
Last Scan2024-11-15T10:30:27+00:00
Next Scan 2024-11-22T10:30:27+00:00

Last Scan

Scanned2024-11-15T10:30:27+00:00
URL https://portaldoholanda.com.br/robots.txt
Redirect https://www.portaldoholanda.com.br/robots.txt
Redirect Domain www.portaldoholanda.com.br
Redirect Base portaldoholanda.com.br
Domain IPs 104.21.5.93, 172.67.133.64, 2606:4700:3031::6815:55d, 2606:4700:3033::ac43:8540
Redirect IPs 104.21.5.93, 172.67.133.64, 2606:4700:3031::6815:55d, 2606:4700:3033::ac43:8540
Response IP 104.21.5.93
Found Yes
Hash 3ca2f3bca91d8adf1d36f2e25a238c7264d751b84a989d8e3dd0060f01f36082
SimHash 38145d0ac57c

Groups

*

Rule Path
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /logout/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /painel
Disallow /user
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /brasil/brasil-tem-84-dos-municipios-em-situacao-fiscal-dificil-ou-critica
Disallow /boost_stats.php
Disallow /policial/apos-briga-veja-lutador-de-mma-algemado-e-deformado-em-spa-de-manaus
Disallow /famosos-tv/cantora-gospel-tem-fotos-sensuais-divulgadas-na-internet
Disallow /brasil/novas-fotos-de-cantora-gospel-sao-publicadas-na-internet
Disallow /eyeblaster
Disallow /addineyeV2.html
Disallow /addineyeV2-secure.html
Disallow /eyeblaster/addineyeV2-secure.html
Disallow /policial/por-querer-vingar-morte-da-irma-homem-e-linchado-no-riacho-doce
Disallow /policial/triplo-homicidio-em-rio-preto-da-eva
Disallow /noticia/tr%C3%83%C2%AAs-homens-assassinados-em-manaus-e-corpos-jogados-no-ramal-veja-fotos
Disallow /policial/anjinha-da-noite-e-presa-por-trafico-e-receptacao
Disallow /noticia/processos-movidos-contra-publicitaria-que-teria-simulado-gravidez-sao-suspensos
Disallow /falsificacao-de-documentos?page=9
Disallow /publicitaria?page=9
Disallow /atriz/grazi-massafera-e-flagrada-em-cenas-quentes-em-tocantins-veja
Disallow /amazonas/formandos-de-fisioterapia-que-esperavam-ter-preta-gil-no-baile-de-formatura-dizem-ter-sido?page=3077&hc_location=ufi
Disallow /sites/all/themes/portal2016/comum/server_status.php
Disallow /sites/all/themes/portal2016/comum/server_stats.php
Disallow /sites/all/themes/portal2016/comum/server_status.html
Disallow /amazonas/delegado-e-encontrado-apos-desaparecer-durante-confronto-com-traficantes
Disallow /taxonomyaaaaa/term/6?page=650
Disallow /amazonas/fraude-de-r-1-bilhao-em-precatorios-envolve-sindicato-presidente-do-trt-desembargadores-e-j
Disallow /amazonas/juiz-diz-que-nao-ha-erro-em-calculo-de-precatorio
Disallow /amazonas/envolvidos-em-suposto-desvio-de-precatorios-no-trt-depoem-na-justica-federal
Disallow /amazonas/desembargadora-rechaca-acusacao-e-diz-que-honorarios-foram-legitimos
Disallow /famosos/voltaram-ex-bbb-ariadna-curte-praia-com-o-ex-noivo
Disallow /bastidores-da-politica/seduc-seduc
Disallow /bastidores-da-politica/transporte-escolar
Disallow /noticia-hoje/liliane-araujo-e-suspeita-de-ter-cometido-fraude-nas-eleicoes-em-manaus
Disallow /noticia-hoje/em-manaus-liliane-araujo-contesta-participacao-em-fraude-nas-eleicoes

Other Records

Field Value
crawl-delay 10

googlebot
adsbot-google

Rule Path
Disallow /variedades/melhores-lugares-para-apostas-em-lol-guia-de-como-apostar
Disallow /amazonas/fabricante-da-proxalutamida-exclui-estudo-do-amazonas-com-indicios-de-fraude-em-dossie-para-anvisa
Disallow /amazonas/conep-denuncia-estudo-com-proxalutamida-no-amazonas-200-morreram
Disallow /manaus/comando-vermelho-ordena-que-postos-baixem-preco-dos-combustiveis-em-manaus
Disallow /affair/rihanna-e-flagrada-com-milionario-em-clima-quente-dentro-de-piscina
Disallow /sites/default/files/imagecache/2016_noticia_topo/captura_de_tela_2017-06-28_as_09.51.28.jpg

facebookexternalhit

Rule Path
Allow /

facebot

Rule Path
Allow /

hootsuite

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.portaldoholanda.com.br/sitemap.xml

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)