dlyavann.ru
robots.txt
Robots Exclusion Standard data for dlyavann.ru
Resource Scan
Scan Details
| Site Domain | dlyavann.ru |
| Base Domain | dlyavann.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-24T16:45:13+00:00 |
| Next Scan | 2024-06-23T16:45:13+00:00 |
Last Successful Scan
| Scanned | 2024-04-02T13:14:39+00:00 |
| URL | https://dlyavann.ru/robots.txt |
| Redirect | https://www.dlyavann.ru/robots.txt |
| Redirect Domain | www.dlyavann.ru |
| Redirect Base | dlyavann.ru |
| Domain IPs | 104.26.4.250, 104.26.5.250, 172.67.75.93 |
| Redirect IPs | 104.26.4.250, 104.26.5.250, 172.67.75.93 |
| Response IP | 104.26.4.250 |
| Found | Yes |
| Hash | 67d35c96f72253758d0204272dff8f9021640aa9a88055a822ec94d8de0514d9 |
| SimHash | 4f85ec637733 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /noveltys/$ |
| Allow | /actions/$ |
| Allow | /sales/$ |
| Disallow | /noveltys/* |
| Disallow | /actions/* |
| Disallow | /sales/* |
| Disallow | /? |
| Disallow | /*?*sort_by |
| Disallow | /*?*view_as |
| Disallow | /*?*show |
| Disallow | /*?*param |
| Disallow | /*?*countries |
| Disallow | /*?*brands |
| Disallow | /*?*price |
| Disallow | /*?*advanced_search |
| Disallow | /*?*type |
| Disallow | /*%26 |
| Disallow | /*utm_source%3D |
| Disallow | /*_openstat%3D |
| Disallow | /*openstat%3D |
| Disallow | /*gclid%3D |
| Disallow | /*yclid%3D |
| Disallow | /search |
| Disallow | /cart |
| Disallow | /login |
| Disallow | /reminder |
| Disallow | /registration |
| Disallow | /manage.php |
| Disallow | /order |
| Disallow | /payment |
| Disallow | /model |
| Disallow | /tovary |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Allow | /noveltys/$ |
| Allow | /actions/$ |
| Allow | /sales/$ |
| Disallow | /noveltys/* |
| Disallow | /actions/* |
| Disallow | /sales/* |
| Disallow | /? |
| Disallow | /*?*sort_by |
| Disallow | /*?*view_as |
| Disallow | /*?*show |
| Disallow | /*?*param |
| Disallow | /*?*countries |
| Disallow | /*?*brands |
| Disallow | /*?*price |
| Disallow | /*?*advanced_search |
| Disallow | /*?*type |
| Disallow | /*%26 |
| Disallow | /*utm_source%3D |
| Disallow | /*_openstat%3D |
| Disallow | /*openstat%3D |
| Disallow | /*gclid%3D |
| Disallow | /*yclid%3D |
| Disallow | /search |
| Disallow | /cart |
| Disallow | /login |
| Disallow | /reminder |
| Disallow | /registration |
| Disallow | /manage.php |
| Disallow | /order |
| Disallow | /payment |
| Disallow | /model |
| Disallow | /tovary |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.dlyavann.ru/sitemap-index.xml |
| sitemap | http://www.dlyavann.ru/sitemap-images-index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.