aif.ru
robots.txt
Robots Exclusion Standard data for aif.ru
Resource Scan
Scan Details
| Site Domain | aif.ru |
| Base Domain | aif.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-12T20:30:49+00:00 |
| Next Scan | 2024-11-19T20:30:49+00:00 |
Last Scan
| Scanned | 2024-11-12T20:30:49+00:00 |
| URL | https://aif.ru/robots.txt |
| Domain IPs | 186.2.163.44 |
| Response IP | 186.2.163.44 |
| Found | Yes |
| Hash | 4f69dd67a9cf923f41c15b2d8b4162950d5fcdf319c8458d04169d98775226f5 |
| SimHash | 02059784ab23 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Allow | *?erid=* |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | *rate_plus%3D |
yandex
| Rule | Path |
|---|---|
| Allow | /comments |
| Allow | /authors/ |
| Allow | *?erid=* |
| Disallow | *?* |
| Disallow | /comments_ajx |
| Disallow | /form/offerpopupp |
| Disallow | /view/ |
| Disallow | *_comments |
| Disallow | /auth$ |
| Disallow | /admin |
| Disallow | /adminold |
| Disallow | /registration |
| Disallow | /profile |
| Disallow | /recovery |
| Disallow | /search |
| Disallow | /fb/ |
| Disallow | /media |
| Disallow | /contestallusers |
| Disallow | /iframes |
| Disallow | /extraform/*/list |
| Disallow | /extraform/*/rules |
| Disallow | /extraform/*?test |
| Disallow | /voting/index.php |
| Disallow | /i/ |
| Disallow | /z2 |
| Disallow | /scripts |
| Disallow | /images |
| Disallow | /shop/esshop/cart |
| Disallow | /shop/esuser/register |
| Disallow | /shop/esuser/forgotpass |
| Disallow | /shop/archive |
| Disallow | /*rss_pap |
| Disallow | /all/hit |
| Disallow | /all/comment |
| Disallow | /tag/id/ |
| Disallow | /docs |
| Disallow | /subscription/ |
| Disallow | *rate_plus%3D1 |
| Disallow | *sa%3D* |
| Disallow | */amp/* |
| Disallow | *?utm_source&utm_campaign&utm_medium&utm_referrer&utm_content&utm_term&nw&gl&from&key |
| Disallow | *?utm_source=aifrelated&utm_medium=click&utm_campaign=aifrelated |
Other Records
| Field | Value |
|---|---|
| sitemap | https://aif.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.