aif.ua
robots.txt
Robots Exclusion Standard data for aif.ua
Resource Scan
Scan Details
| Site Domain | aif.ua |
| Base Domain | aif.ua |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-07-07T14:52:17+00:00 |
| Next Scan | 2024-10-05T14:52:17+00:00 |
Last Successful Scan
| Scanned | 2022-06-30T16:09:27+00:00 |
| URL | https://aif.ua/robots.txt |
| Response IP | 190.115.31.231 |
| Found | Yes |
| Hash | b3ea3e470a24e3f18b1f6809b0fe255d7445201f2cf28bc6463ab07ea1225bfa |
| SimHash | 020d8f10ab23 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | /realty/city/2228426 |
| Disallow | /realty/city/glava_rosreestra_rosreestr_uluchshaet_investicionnyy_klimat |
| Disallow | /redesign2018 |
| Allow | /redesign2018/css |
| Allow | /redesign2018/fonts |
| Allow | /redesign2018/img |
| Allow | /redesign2018/img_dop |
| Allow | /redesign2018/js |
| Disallow | *rate_plus%3D |
yandex
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | /realty/city/2228426 |
| Disallow | /realty/city/glava_rosreestra_rosreestr_uluchshaet_investicionnyy_klimat |
| Disallow | /redesign2018 |
| Allow | /redesign2018/css |
| Allow | /redesign2018/fonts |
| Allow | /redesign2018/img |
| Allow | /redesign2018/img_dop |
| Allow | /redesign2018/js |
| Disallow | *rate_plus%3D1 |
| Disallow | *sa%3D* |
| Disallow | */amp/* |
| Disallow | *?utm_source&utm_campaign&utm_medium&utm_referrer&utm_content&utm_term&nw&gl&from&key |
| Disallow | *?utm_source=aifrelated&utm_medium=click&utm_campaign=aifrelated |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://aif.ua/sitemap.xml |
Warnings
- `clean-param` is not a known field.