araujo.com.br
robots.txt
Robots Exclusion Standard data for araujo.com.br
Resource Scan
Scan Details
| Site Domain | araujo.com.br |
| Base Domain | araujo.com.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-20T17:28:10+00:00 |
| Next Scan | 2024-09-27T17:28:10+00:00 |
Last Successful Scan
| Scanned | 2024-09-05T16:55:59+00:00 |
| URL | https://araujo.com.br/robots.txt |
| Redirect | https://www.araujo.com.br/robots.txt |
| Redirect Domain | www.araujo.com.br |
| Redirect Base | araujo.com.br |
| Domain IPs | 104.17.191.16, 104.17.192.16 |
| Redirect IPs | 2600:1413:b000:6::17d5:2bd2, 2600:1413:b000:6::17d5:2bdc, 96.17.96.22, 96.17.96.32 |
| Response IP | 23.44.5.8 |
| Found | Yes |
| Hash | 2e10e3e51aa9c24769e3ed543c1df111d5ff4ef4d457a6964ba19e35b147fd47 |
| SimHash | 0f98506a9441 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /login |
| Disallow | /checkout |
| Disallow | /my-cart |
| Disallow | /minha-conta |
| Disallow | /meus-favoritos |
| Disallow | /meus-pedidos |
| Disallow | /meu-cadastro |
| Disallow | /meus-enderecos |
| Disallow | /meus-cartoes |
| Disallow | /cartoes-presente |
| Disallow | /chamados |
| Disallow | /pedido |
| Disallow | /busca?q=* |
| Disallow | /*?q=* |
| Disallow | /on/demandware.store/Sites-Araujo-Site* |
| Disallow | /favicon.ico |
| Disallow | /busca?cgid=* |
| Allow | /*.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.araujo.com.br/sitemap_index.xml |