dunkshoes.net.br
robots.txt
Robots Exclusion Standard data for dunkshoes.net.br
Resource Scan
Scan Details
| Site Domain | dunkshoes.net.br |
| Base Domain | dunkshoes.net.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-21T02:23:16+00:00 |
| Next Scan | 2024-08-19T02:23:16+00:00 |
Last Successful Scan
| Scanned | 2023-04-04T18:08:34+00:00 |
| URL | https://www.dunkshoes.net.br/robots.txt |
| Domain IPs | 18.155.68.100, 18.155.68.37, 18.155.68.55, 18.155.68.69 |
| Response IP | 18.155.68.69 |
| Found | Yes |
| Hash | 0d153db7b7c08d84802097b8d3c5a2091ebdb261fc443112bb0a5b0301c428fb |
| SimHash | 6a0cc002e2b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /central/* |
| Disallow | /carrinho/* |
| Disallow | /checkout/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /cdn/assets/ |