rostov-generatory.ru
robots.txt

Robots Exclusion Standard data for rostov-generatory.ru

Resource Scan

Scan Details

Site Domain rostov-generatory.ru
Base Domain rostov-generatory.ru
Scan Status Ok
Last Scan2024-09-17T04:32:10+00:00
Next Scan 2024-10-17T04:32:10+00:00

Last Scan

Scanned2024-09-17T04:32:10+00:00
URL https://rostov-generatory.ru/robots.txt
Domain IPs 91.201.52.251
Response IP 91.201.52.251
Found Yes
Hash 4671187f8e16d5248622cf47536c341d52b1cabb8aee00de63cb339635d8e10a
SimHash 6e498b35a437

Groups

*

Rule Path
Allow /
Allow /bitrix/components/
Allow /bitrix/cache/
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/panel/
Allow */index.php
Disallow /bitrix/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER_BY
Disallow /*PAGEN
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*?bxajaxid=
Disallow /*%26bxajaxid%3D
Disallow /*?view_result=
Disallow /*%26view_result%3D
Disallow /action
Disallow /suppliers
Disallow /personal
Disallow /docs
Disallow /shops
Disallow /delivery
Disallow /payment
Disallow /register
Disallow /forgot_password
Disallow /change_password
Disallow /auth
Disallow /login
Disallow /logout
Disallow /include/popup/buy1click/
Disallow /delivery/
Disallow /auth/
Disallow /suppliers/
Disallow /include/popup/nasvyazi/
Disallow /personal/private/
Disallow /include/easycart/favorite.php
Disallow /include/popup/mycity/
Disallow /?bx_sender_conversion_id=16517
Disallow /catalog/import/

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandexmedia

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexblogs

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexmetrika

Rule Path
Allow /

yandexmarket

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://rostov-generatory.ru/sitemap.xml
sitemap https://rostov-generatory.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.