yarferma.ru
robots.txt
Robots Exclusion Standard data for yarferma.ru
Resource Scan
Scan Details
| Site Domain | yarferma.ru |
| Base Domain | yarferma.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-17T14:41:30+00:00 |
| Next Scan | 2024-10-17T14:41:30+00:00 |
Last Scan
| Scanned | 2024-09-17T14:41:30+00:00 |
| URL | https://yarferma.ru/robots.txt |
| Domain IPs | 80.90.187.102 |
| Response IP | 80.90.187.102 |
| Found | Yes |
| Hash | 3f1490d39665986f44e39f673aef105e42118078d659b89b64b6267b025bdd8e |
| SimHash | 6e608e5963b5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/panel/ |
| Allow | /bitrix/fonts/ |
| Allow | /bitrix/tools/ |
| Allow | /bitrix/images/ |
| Allow | /bitrix/css/ |
| Allow | /yandex.zen/ |
| Allow | /*/rss/* |
| Disallow | /index.php |
| Disallow | /registration.php |
| Disallow | /*utm_source%3D* |
| Disallow | /*utm_medium%3D* |
| Disallow | /*utm_campaign%3D* |
| Disallow | /*utm_content%3D* |
| Disallow | /*utm_term%3D* |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /bitrix/ |
| Disallow | /auth/ |
| Disallow | /search/ |
| Disallow | /*/search/ |
| Disallow | /*ID%3D |
| Disallow | /*/slide_show/ |
| Disallow | /?* |
| Disallow | /*?PAGEN |
| Disallow | /page*.php |
| Disallow | /*PAGEN_1%3D |
| Disallow | /*PAGEN_2%3D |
| Disallow | /*PAGEN_3%3D |
| Disallow | /*PAGEN_4%3D |
| Disallow | /*PAGEN_5%3D |
| Disallow | /*PAGEN_6%3D |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*r1%3D |
| Disallow | /*r2%3D |
| Disallow | /*r3%3D |
| Disallow | /*r4%3D |
| Disallow | /*r5%3D |
| Disallow | /*source%3D |
| Disallow | /*added%3D |
| Disallow | /*block%3D |
| Disallow | /*pos%3D |
| Disallow | /*type%3D |
| Disallow | /*country%3D |
| Disallow | /*show_all%3D |
| Disallow | /*?action= |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*SHOWALL |
| Disallow | /*level%3D |
| Disallow | /*design%3D |
| Disallow | /*category%3D |
| Disallow | /*company_name%3D |
| Disallow | /*rss |
| Disallow | /rss/ |
yandex
| Rule | Path |
|---|---|
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/panel/ |
| Allow | /bitrix/fonts/ |
| Allow | /bitrix/tools/ |
| Allow | /bitrix/images/ |
| Allow | /bitrix/css/ |
| Allow | /yandex.zen/ |
| Allow | /*/rss/* |
| Disallow | /index.php |
| Disallow | /*from%3Dadwords |
| Disallow | /bitrix/ |
| Disallow | /auth/ |
| Disallow | /search/ |
| Disallow | /*/search/ |
| Disallow | /*ID%3D |
| Disallow | /*/slide_show/ |
| Disallow | /?* |
| Disallow | /*?PAGEN |
| Disallow | /page*.php |
| Disallow | /*PAGEN_1%3D |
| Disallow | /*PAGEN_2%3D |
| Disallow | /*PAGEN_3%3D |
| Disallow | /*PAGEN_4%3D |
| Disallow | /*PAGEN_5%3D |
| Disallow | /*PAGEN_6%3D |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*r1%3D |
| Disallow | /*r2%3D |
| Disallow | /*r3%3D |
| Disallow | /*r4%3D |
| Disallow | /*r5%3D |
| Disallow | /*source%3D |
| Disallow | /*added%3D |
| Disallow | /*block%3D |
| Disallow | /*pos%3D |
| Disallow | /*type%3D |
| Disallow | /*country%3D |
| Disallow | /*show_all%3D |
| Disallow | /*?action= |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*SHOWALL |
| Disallow | /*level%3D |
| Disallow | /*design%3D |
| Disallow | /*category%3D |
| Disallow | /*company_name%3D |
| Disallow | /*rss |
| Disallow | /rss/ |
| Disallow | /auth.php |
| Disallow | /registration.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
googlebot
| Rule | Path |
|---|---|
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/panel/ |
| Allow | /bitrix/fonts/ |
| Allow | /bitrix/tools/ |
| Allow | /bitrix/images/ |
| Allow | /bitrix/css/ |
| Allow | /yandex.zen/ |
| Allow | /*/rss/* |
| Disallow | /index.php |
| Disallow | /*utm_source%3D* |
| Disallow | /*utm_medium%3D* |
| Disallow | /*utm_campaign%3D* |
| Disallow | /*utm_content%3D* |
| Disallow | /*utm_term%3D* |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /bitrix/ |
| Disallow | /auth/ |
| Disallow | /search/ |
| Disallow | /*/search/ |
| Disallow | /*ID%3D |
| Disallow | /*/slide_show/ |
| Disallow | /?* |
| Disallow | /*?PAGEN |
| Disallow | /page*.php |
| Disallow | /*PAGEN_1%3D |
| Disallow | /*PAGEN_2%3D |
| Disallow | /*PAGEN_3%3D |
| Disallow | /*PAGEN_4%3D |
| Disallow | /*PAGEN_5%3D |
| Disallow | /*PAGEN_6%3D |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*r1%3D |
| Disallow | /*r2%3D |
| Disallow | /*r3%3D |
| Disallow | /*r4%3D |
| Disallow | /*r5%3D |
| Disallow | /*source%3D |
| Disallow | /*added%3D |
| Disallow | /*block%3D |
| Disallow | /*pos%3D |
| Disallow | /*type%3D |
| Disallow | /*country%3D |
| Disallow | /*show_all%3D |
| Disallow | /*?action= |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*SHOWALL |
| Disallow | /*level%3D |
| Disallow | /*design%3D |
| Disallow | /*category%3D |
| Disallow | /*company_name%3D |
| Disallow | /*rss |
| Disallow | /rss/ |
| Disallow | /auth.php |
| Disallow | /registration.php |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /*utm_source%3D* |
| Disallow | /*utm_medium%3D* |
| Disallow | /*utm_campaign%3D* |
| Disallow | /*utm_content%3D* |
| Disallow | /*utm_term%3D* |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /bitrix/ |
| Disallow | /auth/ |
| Disallow | /search/ |
| Disallow | /*/search/ |
| Disallow | /*ID%3D |
| Disallow | /*/slide_show/ |
| Disallow | /?* |
| Disallow | /*?PAGEN |
| Disallow | /page*.php |
| Disallow | /*PAGEN_1%3D |
| Disallow | /*PAGEN_2%3D |
| Disallow | /*PAGEN_3%3D |
| Disallow | /*PAGEN_4%3D |
| Disallow | /*PAGEN_5%3D |
| Disallow | /*PAGEN_6%3D |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*r1%3D |
| Disallow | /*r2%3D |
| Disallow | /*r3%3D |
| Disallow | /*r4%3D |
| Disallow | /*r5%3D |
| Disallow | /*source%3D |
| Disallow | /*added%3D |
| Disallow | /*block%3D |
| Disallow | /*pos%3D |
| Disallow | /*type%3D |
| Disallow | /*country%3D |
| Disallow | /*show_all%3D |
| Disallow | /*?action= |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*SHOWALL |
| Disallow | /*level%3D |
| Disallow | /*design%3D |
| Disallow | /*category%3D |
| Disallow | /*company_name%3D |
| Disallow | /*rss |
| Disallow | /rss/ |
| Disallow | /auth.php |
| Disallow | /registration.php |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/panel/ |
| Allow | /bitrix/fonts/ |
| Allow | /bitrix/tools/ |
| Allow | /bitrix/images/ |
| Allow | /bitrix/css/ |
| Allow | /yandex.zen/ |
| Allow | /*/rss/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://yarferma.ru/sitemap.xml |
| sitemap | https://yarferma.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.