chel.aif.ru
robots.txt
Robots Exclusion Standard data for chel.aif.ru
Resource Scan
Scan Details
| Site Domain | chel.aif.ru |
| Base Domain | aif.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-20T07:30:39+00:00 |
| Next Scan | 2024-06-19T07:30:39+00:00 |
Last Scan
| Scanned | 2024-05-20T07:30:39+00:00 |
| URL | https://chel.aif.ru/robots.txt |
| Domain IPs | 186.2.163.44 |
| Response IP | 186.2.163.44 |
| Found | Yes |
| Hash | 6e8361bd60815a64051ec799fa6e778dedbe19b3c80c2eaee441aea6b06fc66b |
| SimHash | 02078f948b23 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Allow | *?erid=* |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | /realty/city/2228426 |
| Disallow | /realty/city/glava_rosreestra_rosreestr_uluchshaet_investicionnyy_klimat |
| Disallow | /redesign2018 |
| Allow | /redesign2018/css |
| Allow | /redesign2018/fonts |
| Allow | /redesign2018/img |
| Allow | /redesign2018/img_dop |
| Allow | /redesign2018/js |
| Disallow | *rate_plus%3D |
| Disallow | /money/market/bulavin_obem_parallelnogo_importa_v_rf_prevysil_20_milliardov_dollarov |
yandex
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Allow | *?erid=* |
| Disallow | *?* |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | /realty/city/2228426 |
| Disallow | /realty/city/glava_rosreestra_rosreestr_uluchshaet_investicionnyy_klimat |
| Disallow | /redesign2018 |
| Allow | /redesign2018/css |
| Allow | /redesign2018/fonts |
| Allow | /redesign2018/img |
| Allow | /redesign2018/img_dop |
| Allow | /redesign2018/js |
| Disallow | *rate_plus%3D1 |
| Disallow | *sa%3D* |
| Disallow | */amp/* |
| Disallow | *?utm_source&utm_campaign&utm_medium&utm_referrer&utm_content&utm_term&nw&gl&from&key |
| Disallow | *?utm_source=aifrelated&utm_medium=click&utm_campaign=aifrelated |
| Disallow | /money/market/bulavin_obem_parallelnogo_importa_v_rf_prevysil_20_milliardov_dollarov |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chel.aif.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.