midias.correiobraziliense.com.br
robots.txt
Robots Exclusion Standard data for midias.correiobraziliense.com.br
Resource Scan
Scan Details
Site Domain | midias.correiobraziliense.com.br |
Base Domain | correiobraziliense.com.br |
Scan Status | Ok |
Last Scan | 2024-05-25T19:02:09+00:00 |
Next Scan | 2024-06-24T19:02:09+00:00 |
Last Scan
Scanned | 2024-05-25T19:02:09+00:00 |
URL | https://midias.correiobraziliense.com.br/robots.txt |
Domain IPs | 179.191.185.64 |
Response IP | 179.191.185.64 |
Found | Yes |
Hash | ac16af987b3b21ddd3f779c9a6f60ac2639ad3e58b57d1e77b59e5236d4e9938 |
SimHash | 6904ce776fd2 |
Groups
*
Rule | Path |
---|---|
Allow | * |
Disallow | /autor/* |
Disallow | /busca/* |
Disallow | /search/* |
Disallow | /tags/* |
Disallow | /related/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.correiobraziliense.com.br/sitemap/map/day/sitemap.xml |
sitemap | https://www.correiobraziliense.com.br/sitemap/2.xml |
sitemap | https://www.correiobraziliense.com.br/sitemap/1.xml |
sitemap | https://www.correiobraziliense.com.br/sitemap/map/day/sitemap-news.xml |