103.by
robots.txt
Robots Exclusion Standard data for 103.by
Resource Scan
Scan Details
| Site Domain | 103.by |
| Base Domain | 103.by |
| Scan Status | Ok |
| Last Scan | 2024-11-15T17:44:37+00:00 |
| Next Scan | 2024-11-22T17:44:37+00:00 |
Last Scan
| Scanned | 2024-11-15T17:44:37+00:00 |
| URL | https://103.by/robots.txt |
| Redirect | https://www.103.by/robots.txt |
| Redirect Domain | www.103.by |
| Redirect Base | 103.by |
| Domain IPs | 193.176.182.177, 193.176.182.178 |
| Redirect IPs | 193.176.182.177, 193.176.182.178 |
| Response IP | 193.176.182.177 |
| Found | Yes |
| Hash | 8581ee0617b851c03fa9b2567d2129859699deb2d6ac4f5505bb41c8c5334333 |
| SimHash | 8318cd449c38 |
Groups
*
| Rule | Path |
|---|---|
| Allow | *?page= |
| Disallow | *?page=*& |
| Allow | /spec/*/?placeId= |
| Allow | /sellers/*/?seller_url= |
| Allow | *?sort=new-down |
| Disallow | /upload/ |
| Disallow | /search/ |
| Disallow | /index |
| Disallow | /z/ |
| Disallow | /r/ |
| Disallow | *%26 |
| Disallow | *? |
| Disallow | *?page=1$ |
| Disallow | *?page=1& |
| Disallow | /top-sellers/ |
| Disallow | /profile/ |
| Disallow | /qr/* |
| Allow | /digital/ |
yandex
| Rule | Path |
|---|---|
| Allow | *?page= |
| Disallow | *?page=*& |
| Allow | /spec/*/?placeId= |
| Allow | /sellers/*/?seller_url= |
| Allow | *?sort=new-down |
| Disallow | /upload/ |
| Disallow | /search/ |
| Disallow | /index |
| Disallow | /z/ |
| Disallow | /r/ |
| Disallow | *%26 |
| Disallow | *? |
| Disallow | *?page=1$ |
| Disallow | *?page=1& |
| Disallow | /top-sellers/ |
| Disallow | /profile/ |
| Disallow | /qr/* |
| Allow | /digital/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.103.by/sitemap.xml |
Warnings
- `host` is not a known field.