estadao.com
robots.txt
Robots Exclusion Standard data for estadao.com
Resource Scan
Scan Details
| Site Domain | estadao.com |
| Base Domain | estadao.com |
| Scan Status | Ok |
| Last Scan | 4/14/2025, 1:08:06 AM |
| Next Scan | 4/21/2025, 1:08:06 AM |
Last Scan
| Scanned | 4/14/2025, 1:08:06 AM |
| URL | https://estadao.com/robots.txt |
| Redirect | https://www.estadao.com.br/robots.txt |
| Redirect Domain | www.estadao.com.br |
| Redirect Base | estadao.com.br |
| Domain IPs | 96.17.96.25, 96.17.96.31 |
| Redirect IPs | 23.52.171.88, 23.52.171.98, 2600:1413:b000:13::b857:c194, 2600:1413:b000:13::b857:c19e |
| Response IP | 23.52.171.138 |
| Found | Yes |
| Hash | 511d31ee42fc45a0bc0c469d51e3b4f87e606b699179762035882d1a203cee18 |
| SimHash | 2e149b6851b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ewok |
| Disallow | /logs |
| Disallow | /robos-linux |
| Disallow | /shared |
| Disallow | /estadao |
| Disallow | /newsletter/ |
| Disallow | /correcoes/enviar?url=* |
| Disallow | /ext/ |
| Disallow | /eleicoes/2018/busca* |
| Disallow | /eleicoes/2020/busca* |
| Disallow | /feed/$ |
| Disallow | /politica/eleicoes/2024/candidatos-*/*/vice-prefeito/$ |
| Disallow | /politica/eleicoes/2024/candidatos-*/prefeito/$ |
| Disallow | /politica/eleicoes/2024/candidatos-*/vereador/$ |
| Disallow | /politica/eleicoes/2024/candidatos-*/vice-prefeito/$ |
| Disallow | /politica/eleicoes/2024/candidatos/* |
| Allow | /politica/eleicoes/2024/candidatos-*/*/prefeito/$ |
| Allow | /politica/eleicoes/2024/candidatos-*/*/vereador/$ |
| Allow | /ext/.pdf |
| Allow | /estadao-verifica |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.estadao.com.br/arc/outboundfeeds/sitemap-index-by-day/?outputType=xml |
| sitemap | https://www.estadao.com.br/sitemaps/custom/www.estadao |
| sitemap | https://www.estadao.com.br/sitemap/galerias/www.estadao/auto.xml |
Comments