ciferblat-shop.ru
robots.txt

Robots Exclusion Standard data for ciferblat-shop.ru

Resource Scan

Scan Details

Site Domain ciferblat-shop.ru
Base Domain ciferblat-shop.ru
Scan Status Ok
Last Scan2024-06-13T23:48:29+00:00
Next Scan 2024-07-13T23:48:29+00:00

Last Scan

Scanned2024-06-13T23:48:29+00:00
URL http://ciferblat-shop.ru/robots.txt
Domain IPs 91.218.229.98
Response IP 91.218.229.98
Found Yes
Hash 10bd9fcc39957a908b3bf751032d0aeaf0c7d0b11e3480715b0aecd23d8255f7
SimHash 06e0d97345b9

Groups

*

Rule Path
Disallow /bitrix/
Disallow /upload/
Disallow /search/
Allow /search/map.php
Disallow /club/search/
Disallow /club/group/search/
Disallow /club/forum/search/
Disallow /communication/forum/search/
Disallow /communication/blog/search.php
Disallow /club/gallery/tags/
Disallow /examples/my-components/
Disallow /examples/download/download_private/
Disallow /auth/
Disallow /auth.php
Disallow /personal/
Disallow /communication/forum/user/
Disallow /e-store/paid/detail.php
Disallow /e-store/affiliates/
Disallow /club/$
Disallow /club/messages/
Disallow /club/log/
Disallow /content/board/my/
Disallow /content/links/my/
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*action%3DADD_TO_COMPARE_LIST
Disallow /*action%3DDELETE_FROM_COMPARE_LIST
Disallow /*action%3DADD2BASKET
Disallow /*action%3DBUY
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

yandex

Rule Path
Disallow /bitrix/
Disallow /upload/
Disallow /search/
Allow /search/map.php
Disallow /club/search/
Disallow /club/group/search/
Disallow /club/forum/search/
Disallow /communication/forum/search/
Disallow /communication/blog/search.php
Disallow /club/gallery/tags/
Disallow /examples/my-components/
Disallow /examples/download/download_private/
Disallow /auth/
Disallow /auth.php
Disallow /personal/
Disallow /communication/forum/user/
Disallow /e-store/paid/detail.php
Disallow /e-store/affiliates/
Disallow /club/$
Disallow /club/messages/
Disallow /club/log/
Disallow /content/board/my/
Disallow /content/links/my/
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*action%3DADD_TO_COMPARE_LIST
Disallow /*action%3DDELETE_FROM_COMPARE_LIST
Disallow /*action%3DADD2BASKET
Disallow /*action%3DBUY
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

yandexbot
yandexmedia
yandeximages
yandexcatalog
yadirectfetcher
yandexblogs
yandexnews
yandexpagechecker
yandexmetrika
yandexmarket
yandexcalendar
yandexaccessibilitybot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Warnings

  • `host` is not a known field.