ask-prof.ru
robots.txt
Robots Exclusion Standard data for ask-prof.ru
Resource Scan
Scan Details
Site Domain | ask-prof.ru |
Base Domain | ask-prof.ru |
Scan Status | Ok |
Last Scan | 2024-05-11T07:45:58+00:00 |
Next Scan | 2024-06-10T07:45:58+00:00 |
Last Scan
Scanned | 2024-05-11T07:45:58+00:00 |
URL | https://ask-prof.ru/robots.txt |
Domain IPs | 5.23.50.132 |
Response IP | 5.23.50.132 |
Found | Yes |
Hash | 8d7cdd70d48c0c82f58fc360c42f64294ced08adf2c44e606bbdb5065c359c7c |
SimHash | 291c46c29e17 |
Groups
*
Product | Comment |
---|---|
* | правила для всех роботов |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | папка на хостинге |
Disallow | /bitrix/ | папка с системными файлами битрикса |
Disallow | *bitrix_*%3D | GET-запросы битрикса |
Disallow | /local/ | папка с системными файлами битрикса |
Disallow | /*index.php$ | дубли страниц index.php |
Disallow | /auth/ | авторизация |
Disallow | *auth%3D | авторизация |
Disallow | /personal/ | личный кабинет |
Disallow | *register%3D | регистрация |
Disallow | *forgot_password%3D | забыли пароль |
Disallow | *change_password%3D | изменить пароль |
Disallow | *login%3D | логин |
Disallow | *logout%3D | выход |
Disallow | */search/ | поиск |
Disallow | *action%3D | действия |
Disallow | *print%3D | печать |
Disallow | *?new=Y | новая страница |
Disallow | *?edit= | редактирование |
Disallow | *?preview= | предпросмотр |
Disallow | *backurl%3D | трекбеки |
Disallow | *back_url%3D | трекбеки |
Disallow | *back_url_admin%3D | трекбеки |
Disallow | *captcha | каптча |
Disallow | */feed | все фиды |
Disallow | */rss | rss фид |
Disallow | *?FILTER*= | здесь и ниже различные популярные параметры фильтров |
Disallow | *?ei= | - |
Disallow | *?p= | - |
Disallow | *?q= | - |
Disallow | *?sort= | - |
Disallow | *?PAGEN*= | - |
Disallow | *PAGEN*%3D | - |
Disallow | *PAGEN_2%3D | - |
Disallow | *?year= | SSS webmaster |
Disallow | *?sphrase_id= | SSS webmaster |
Disallow | *?lang* | SSS webmaster |
Disallow | *?a= | SSS webmaster |
Disallow | *?display= | - |
Disallow | *?tags= | - |
Disallow | *B_ORDER%3D | - |
Disallow | *BRAND%3D | - |
Disallow | *CLEAR_CACHE%3D | - |
Disallow | *ELEMENT_ID%3D | - |
Disallow | *price_from%3D | - |
Disallow | *price_to%3D | - |
Disallow | *linerow%3D | - |
Disallow | *page%3D | - |
Disallow | *etext%3D | - |
Disallow | *clear_cache%3D | - |
Disallow | *PROPERTY_TYPE%3D | - |
Disallow | *PROPERTY_WIDTH%3D | - |
Disallow | *PROPERTY_HEIGHT%3D | - |
Disallow | *PROPERTY_DIA%3D | - |
Disallow | *PROPERTY_OPENING_COUNT%3D | - |
Disallow | *PROPERTY_SELL_TYPE%3D | - |
Disallow | *PROPERTY_MAIN_TYPE%3D | - |
Disallow | *PROPERTY_PRICE%5B*%5D%3D | - |
Disallow | *S_LAST%3D | - |
Disallow | *SECTION_ID%3D | - |
Disallow | *SECTION%5B*%5D%3D | - |
Disallow | *SHOWALL%3D | - |
Disallow | *SHOW_ALL%3D | - |
Disallow | *SHOWBY%3D | - |
Disallow | *SORT%3D | - |
Disallow | *SPHRASE_ID%3D | - |
Disallow | *TYPE%3D | - |
Disallow | *utm*%3D | ссылки с utm-метками |
Disallow | *openstat%3D | ссылки с метками openstat |
Disallow | *from%3D | ссылки с метками from |
Disallow | *fksospc_cup* | - |
Disallow | *?oid= | - |
Disallow | *?ignorethis= | - |
Disallow | *?pagen*= | - |
Disallow | */?yadclid=* | - |
Disallow | */?t=* | - |
Disallow | */?yadordid=* | - |
Disallow | */?_ym_status-check=* | - |
Disallow | */?destination=* | - |
Disallow | */?r1=* | - |
Disallow | */?r2=* | - |
Allow | */upload/ | открываем папку с файлами uploads |
Allow | /bitrix/*.js | здесь и далее открываем для индексации скрипты |
Allow | /bitrix/*.css | - |
Allow | /local/*.js | - |
Allow | /local/*.css | - |
Allow | /local/*.jpg | - |
Allow | /local/*.jpeg | - |
Allow | /local/*.png | - |
Allow | /local/*.gif | - |
Other Records
Field | Value |
---|---|
sitemap | https://ask-prof.ru/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
Comments