previsao-do-tempo.estadao.com.br
robots.txt

Robots Exclusion Standard data for previsao-do-tempo.estadao.com.br

Resource Scan

Scan Details

Site Domain previsao-do-tempo.estadao.com.br
Base Domain estadao.com.br
Scan Status Ok
Last Scan2025-03-19T07:07:04+00:00
Next Scan 2025-04-18T07:07:04+00:00

Last Scan

Scanned2025-03-19T07:07:04+00:00
URL https://previsao-do-tempo.estadao.com.br/robots.txt
Redirect https://www.estadao.com.br/robots.txt
Redirect Domain www.estadao.com.br
Redirect Base estadao.com.br
Domain IPs 4.228.90.77
Redirect IPs 184.87.193.80, 184.87.193.89, 2600:1413:b000:13::b857:c194, 2600:1413:b000:13::b857:c19e
Response IP 42.99.140.210
Found Yes
Hash 712c6a5853a357a1855c05c0682ab2ec48ea723fde242a554b575ae967588fa6
SimHash 2e149a6053b2

Groups

*

Rule Path
Disallow /ewok
Disallow /logs
Disallow /robos-linux
Disallow /shared
Disallow /estadao
Disallow /newsletter/
Disallow /correcoes/enviar?url=*
Disallow /ext/
Disallow /eleicoes/2018/busca*
Disallow /eleicoes/2020/busca*
Disallow /feed/$
Disallow /politica/eleicoes/2024/candidatos-*/*/vice-prefeito/$
Disallow /politica/eleicoes/2024/candidatos-*/prefeito/$
Disallow /politica/eleicoes/2024/candidatos-*/vereador/$
Disallow /politica/eleicoes/2024/candidatos-*/vice-prefeito/$
Disallow /politica/eleicoes/2024/candidatos/*
Allow /politica/eleicoes/2024/candidatos-*/*/prefeito/$
Allow /politica/eleicoes/2024/candidatos-*/*/vereador/$
Allow /ext/.pdf
Allow /estadao-verifica

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /opiniao/*

Other Records

Field Value
sitemap https://www.estadao.com.br/arc/outboundfeeds/sitemap-index-by-day/?outputType=xml
sitemap https://www.estadao.com.br/sitemaps/custom/www.estadao
sitemap https://www.estadao.com.br/sitemap/galerias/www.estadao/auto.xml

Comments

  • Support directories
  • Sitemaps