usolie.info
robots.txt
Robots Exclusion Standard data for usolie.info
Resource Scan
Scan Details
| Site Domain | usolie.info |
| Base Domain | usolie.info |
| Scan Status | Ok |
| Last Scan | 2024-05-28T21:21:15+00:00 |
| Next Scan | 2024-06-27T21:21:15+00:00 |
Last Scan
| Scanned | 2024-05-28T21:21:15+00:00 |
| URL | https://usolie.info/robots.txt |
| Domain IPs | 104.21.30.38, 172.67.150.133, 2606:4700:3030::6815:1e26, 2606:4700:3034::ac43:9685 |
| Response IP | 172.67.150.133 |
| Found | Yes |
| Hash | 059bc20cd3cacb8a2d8309fee7a8e78ab630ceba458ea02cb227a61b320e55c8 |
| SimHash | 47db996745f4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bitrix/ |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /*bitrix_include_areas%3D |
| Disallow | /*clear_cache%3D |
| Disallow | /*clear_cache_session%3D |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*PAGEN |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*print_course%3D |
| Disallow | /*?action= |
| Disallow | /*%26action%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*backurl%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*?utm_source= |
| Disallow | /*SHOWALL |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
| Allow | /news/ |
| Allow | */index.php |
| Allow | /articles1/ |
| Allow | /articles/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1.0 |
yandex
| Rule | Path |
|---|---|
| Disallow | /bitrix/ |
| Disallow | /search/ |
| Disallow | /auth/ |
| Disallow | /cgi-bin/ |
| Disallow | /personal/ |
| Disallow | /auth.php |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*backurl%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*index.php?set_filter=* |
| Disallow | /*index.php?sort=* |
| Disallow | /*index.php?arrFilter* |
| Disallow | /mobile_app/ |
| Disallow | /news/*?PAGEN |
| Disallow | /news/video/ |
| Disallow | /*?count |
| Disallow | /*?action |
| Disallow | /access.log |
| Disallow | /*?set_filter=* |
| Disallow | /*?q=* |
| Disallow | /mama/ |
| Disallow | /2015/ |
| Disallow | /foto/ |
| Disallow | /profile/ |
| Disallow | /*SHOWALL |
| Disallow | /search/ |
| Disallow | /catalog/search/ |
| Allow | /news/ |
| Allow | */index.php |
googlebot
| Rule | Path |
|---|---|
| Disallow | /bitrix/ |
| Disallow | /search/ |
| Disallow | /auth/ |
| Disallow | /cgi-bin/ |
| Disallow | /personal/ |
| Disallow | /auth.php |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*backurl%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*index.php?set_filter=* |
| Disallow | /*index.php?sort=* |
| Disallow | /*index.php?arrFilter* |
| Disallow | /*?count |
| Disallow | /*?action |
| Disallow | /access.log |
| Disallow | /*?set_filter=* |
| Disallow | /*?q=* |
| Disallow | /mobile_app/ |
| Disallow | /mama/ |
| Disallow | /2015/ |
| Disallow | /foto/ |
| Disallow | /profile/ |
| Disallow | /*SHOWALL |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://usolie.info/sitemap.xml |
| sitemap | http://usolie.info/sitemap.xml |
| sitemap | https://usolie.info/sitemap.xml |
Warnings
- `host` is not a known field.