superresheba.by
robots.txt
Robots Exclusion Standard data for superresheba.by
Resource Scan
Scan Details
| Site Domain | superresheba.by |
| Base Domain | superresheba.by |
| Scan Status | Ok |
| Last Scan | 2024-11-13T15:28:25+00:00 |
| Next Scan | 2024-11-20T15:28:25+00:00 |
Last Scan
| Scanned | 2024-11-13T15:28:25+00:00 |
| URL | https://superresheba.by/robots.txt |
| Domain IPs | 104.21.23.69, 172.67.209.124, 2606:4700:3035::ac43:d17c, 2606:4700:3036::6815:1745 |
| Response IP | 104.21.23.69 |
| Found | Yes |
| Hash | e4cb4a050d622496ce4d1fa6d8c9ad24a366e3f6f6b9677844ba3348c7f5a731 |
| SimHash | 3d340802e6b4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /resh/category/*-class/page |
| Disallow | /go/ |
| Disallow | /wp-admin/ |
| Disallow | /admin/ |
| Disallow | /author/ |
| Disallow | /resh/tag/ |
| Disallow | /tag/ |
| Disallow | /date/ |
| Disallow | /resh/category/no-category/ |
| Disallow | /order-received |
| Disallow | /dogovor_oferty_superresheba_by.pdf |
| Disallow | /cdn-cgi/ |
| Disallow | /market/default/order-info |
Warnings
- `host` is not a known field.