asfridas.com.br
robots.txt
Robots Exclusion Standard data for asfridas.com.br
Resource Scan
Scan Details
| Site Domain | asfridas.com.br |
| Base Domain | asfridas.com.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-15T10:49:51+00:00 |
| Next Scan | 2024-08-13T10:49:51+00:00 |
Last Successful Scan
| Scanned | 2023-03-29T05:11:20+00:00 |
| URL | https://asfridas.com.br/robots.txt |
| Redirect | https://www.asfridas.com.br/robots.txt |
| Redirect Domain | www.asfridas.com.br |
| Redirect Base | asfridas.com.br |
| Domain IPs | 177.53.140.88 |
| Redirect IPs | 52.84.251.101, 52.84.251.43, 52.84.251.72, 52.84.251.73 |
| Response IP | 52.84.251.72 |
| Found | Yes |
| Hash | 0d153db7b7c08d84802097b8d3c5a2091ebdb261fc443112bb0a5b0301c428fb |
| SimHash | 6a0cc002e2b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /central/* |
| Disallow | /carrinho/* |
| Disallow | /checkout/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /cdn/assets/ |