wildberries.by
robots.txt
Robots Exclusion Standard data for wildberries.by
Resource Scan
Scan Details
| Site Domain | wildberries.by |
| Base Domain | wildberries.by |
| Scan Status | Ok |
| Last Scan | 2024-09-20T17:31:55+00:00 |
| Next Scan | 2024-10-04T17:31:55+00:00 |
Last Scan
| Scanned | 2024-09-20T17:31:55+00:00 |
| URL | https://wildberries.by/robots.txt |
| Redirect | https://www.wildberries.by/robots.txt |
| Redirect Domain | www.wildberries.by |
| Redirect Base | wildberries.by |
| Domain IPs | 185.179.80.73 |
| Redirect IPs | 185.179.80.73 |
| Response IP | 185.179.80.73 |
| Found | Yes |
| Hash | a47eeee7befc80f59f518dc1c03288769d94da34572cf2002e6b6747f5c54b9c |
| SimHash | 6f0c98c3bf71 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /*basket |
| Disallow | /*profile |
| Disallow | /*sort%3D* |
| Disallow | /*pagesize%3D* |
| Disallow | /*targetUrl%3D* |
| Disallow | /*field%3D* |
| Disallow | /*order%3D* |
| Disallow | /*feedbacks |
| Allow | /catalog*page%3D |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*basket |
| Disallow | /*profile |
| Disallow | /*sort%3D* |
| Disallow | /*pagesize%3D* |
| Disallow | /*targetUrl%3D* |
| Disallow | /*field%3D* |
| Disallow | /*order%3D* |
| Disallow | /*feedbacks |
| Allow | /catalog*page%3D |
*
| Rule | Path |
|---|---|
| Disallow | /*basket |
| Disallow | /*profile |
| Disallow | /*sort%3D* |
| Disallow | /*pagesize%3D* |
| Disallow | /*targetUrl%3D* |
| Disallow | /*field%3D* |
| Disallow | /*order%3D* |
| Disallow | /*feedbacks |
| Allow | /catalog*page%3D |
Warnings
- `clean-param` is not a known field.