chv.aif.ru
robots.txt
Robots Exclusion Standard data for chv.aif.ru
Resource Scan
Scan Details
| Site Domain | chv.aif.ru |
| Base Domain | aif.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-20T07:47:37+00:00 |
| Next Scan | 2024-06-19T07:47:37+00:00 |
Last Scan
| Scanned | 2024-05-20T07:47:37+00:00 |
| URL | https://chv.aif.ru/robots.txt |
| Domain IPs | 186.2.163.44 |
| Response IP | 186.2.163.44 |
| Found | Yes |
| Hash | cb4130f361f18f6203c36edd7d468454c6e1c23c51448475e008276a309a481b |
| SimHash | 02178f94ab23 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Allow | *?erid=* |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | /realty/city/2228426 |
| Disallow | /realty/city/glava_rosreestra_rosreestr_uluchshaet_investicionnyy_klimat |
| Disallow | /redesign2018 |
| Allow | /redesign2018/css |
| Allow | /redesign2018/fonts |
| Allow | /redesign2018/img |
| Allow | /redesign2018/img_dop |
| Allow | /redesign2018/js |
| Disallow | *rate_plus%3D |
| Disallow | /money/market/bulavin_obem_parallelnogo_importa_v_rf_prevysil_20_milliardov_dollarov |
yandex
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Allow | *?erid=* |
| Disallow | *?* |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | /realty/city/2228426 |
| Disallow | /realty/city/glava_rosreestra_rosreestr_uluchshaet_investicionnyy_klimat |
| Disallow | /redesign2018 |
| Allow | /redesign2018/css |
| Allow | /redesign2018/fonts |
| Allow | /redesign2018/img |
| Allow | /redesign2018/img_dop |
| Allow | /redesign2018/js |
| Disallow | *rate_plus%3D1 |
| Disallow | *sa%3D* |
| Disallow | */amp/* |
| Disallow | *?utm_source&utm_campaign&utm_medium&utm_referrer&utm_content&utm_term&nw&gl&from&key |
| Disallow | *?utm_source=aifrelated&utm_medium=click&utm_campaign=aifrelated |
| Disallow | /money/market/bulavin_obem_parallelnogo_importa_v_rf_prevysil_20_milliardov_dollarov |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chv.aif.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.