barrasenoticia.com.br
robots.txt
Robots Exclusion Standard data for barrasenoticia.com.br
Resource Scan
Scan Details
| Site Domain | barrasenoticia.com.br |
| Base Domain | barrasenoticia.com.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-02T07:28:21+00:00 |
| Next Scan | 2024-12-31T07:28:21+00:00 |
Last Successful Scan
| Scanned | 2024-06-05T07:25:41+00:00 |
| URL | https://www.barrasenoticia.com.br/robots.txt |
| Domain IPs | 172.253.118.121, 2404:6800:4003:c11::79 |
| Response IP | 74.125.24.121 |
| Found | Yes |
| Hash | 6c5cbb4853bdf9e56803fe62271ec9bbfa9c2eb2631ea384b961ae763b13a81e |
| SimHash | 885a8646ce37 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*_archive.html$ |
| Disallow | /feeds/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.barrasenoticia.com.br/sitemap.xml |
| sitemap | https://www.barrasenoticia.com.br/sitemap-pages.xml |
| sitemap | https://www.barrasenoticia.com.br/atom.xml?redirect=false&start-index=1001&max-results=9000 |
Comments