vkusvill.ru
robots.txt
Robots Exclusion Standard data for vkusvill.ru
Resource Scan
Scan Details
| Site Domain | vkusvill.ru |
| Base Domain | vkusvill.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-16T03:06:20+00:00 |
| Next Scan | 2024-11-23T03:06:20+00:00 |
Last Scan
| Scanned | 2024-11-16T03:06:20+00:00 |
| URL | https://vkusvill.ru/robots.txt |
| Domain IPs | 178.248.232.221 |
| Response IP | 178.248.232.221 |
| Found | Yes |
| Hash | ab5b7161351d93032e93c60ad8fda9e7de48c3c2acbff69e57b3412424c7cfbe |
| SimHash | 4302d866d311 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /stuff/ |
| Disallow | /bitrix/ |
| Disallow | /unsubscribe/ |
| Disallow | /izmeneniya/ |
| Disallow | /tizers_types/ |
| Disallow | /team/ |
| Disallow | /ecobonus/ |
| Disallow | /opros/ |
| Disallow | /superdostavkus/ |
| Disallow | /orderinstructions/ |
| Disallow | /*print%3D |
| Disallow | /404.php |
| Disallow | /*index.php$ |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | */-* |
| Disallow | */?tag=* |
| Disallow | /prices/ |
| Disallow | /new/ |
| Disallow | /friends/ |
| Disallow | /confirm_email/ |
| Disallow | /not_confirmed_email/ |
| Disallow | /en/ |
| Disallow | */?* |
| Disallow | *.html?* |
| Disallow | /personal/ |
| Disallow | /perekus/ |
| Disallow | /news/specialprojects/ |
| Disallow | */xmlid/ |
| Disallow | *yandbtm |
| Disallow | /goods/supermarket/ |
| Disallow | /suppliers/ |
| Disallow | /goods/novinki/* |
| Disallow | /goods/set-novinki/* |
| Disallow | /goods/khity/* |
| Disallow | |
| Disallow | /goods/set-* |
| Disallow | */recipes/filter/ |
| Disallow | */apply/ |
| Disallow | /superdostavkus/ |
| Disallow | /rp3/ |
| Allow | /minify_bx/?t=main-responsive&g=css* |
| Allow | /minify_bx/?t=main-responsive&g=js* |
| Allow | /personal/$ |
| Allow | /shops/?shop* |
| Allow | /bitrix/*.css |
| Allow | /bitrix/*.js |
| Allow | /local/*.css |
| Allow | /local/*.js |
| Allow | /local/templates/main-responsive/fonts/ |
| Allow | /bitrix/*/fonts/ |
| Allow | /en/business/ |
| Allow | /goods/novinki/$ |
| Allow | /goods/set-novinki/$ |
| Allow | /goods/khity/$ |
| Allow | /goods/*?PAGEN |
| Allow | /goods/set-*html |
| Allow | /media/journal/?PAGEN |
| Allow | /media/recipes/*?PAGEN |
| Allow | /media/video/*?PAGEN |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vkusvill.ru/sitemap.xml |