data-by.by
robots.txt
Robots Exclusion Standard data for data-by.by
Resource Scan
Scan Details
| Site Domain | data-by.by |
| Base Domain | data-by.by |
| Scan Status | Ok |
| Last Scan | 2025-11-29T15:27:09+00:00 |
| Next Scan | 2025-12-29T15:27:09+00:00 |
Last Scan
| Scanned | 2025-11-29T15:27:09+00:00 |
| URL | https://data-by.by/robots.txt |
| Domain IPs | 93.125.99.7 |
| Response IP | 93.125.99.7 |
| Found | Yes |
| Hash | 8cafed13767bf5302b74a3f6b3a7ec772b8c47e7da7372257648934116e80a34 |
| SimHash | 693985c2abe7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /manager/ |
| Disallow | /assets/components/ |
| Disallow | /core/ |
| Disallow | /connectors/ |
| Disallow | /index.php |
| Disallow | *?* |
| Disallow | *openstat%3D |
| Disallow | *from%3D |
| Disallow | *utm*%3D |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | |
| Allow | /*.doc |
| Allow | /*.docx |
| Allow | /*.xls |
| Allow | /*.xlsx |
| Allow | /*.ppt |
| Allow | /*.pptx |
| Allow | /*.css |
| Allow | /*.js |
| Allow | *?page= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.data-by.by/sitemap.xml |