tuva.ru
robots.txt

Robots Exclusion Standard data for tuva.ru

Resource Scan

Scan Details

Site Domain tuva.ru
Base Domain tuva.ru
Scan Status Ok
Last Scan2024-10-20T19:26:04+00:00
Next Scan 2024-11-19T19:26:04+00:00

Last Scan

Scanned2024-10-20T19:26:04+00:00
URL https://tuva.ru/robots.txt
Domain IPs 94.230.240.9
Response IP 94.230.240.9
Found Yes
Hash 0cf4d811f8062672b63a449a11ad6bf0bdb494c352e1237d7da90236c369a3d3
SimHash c9e1d3e374b4

Groups

*

Rule Path
Disallow /bitrix/
Disallow /html/
Disallow /upload/
Disallow /search/
Disallow /search/map.php
Disallow /club/search/
Disallow /club/group/search/
Disallow /club/forum/search/
Disallow /communication/forum/search/
Disallow /communication/blog/search.php
Disallow /club/gallery/tags/
Disallow /examples/my-components/
Disallow /examples/download/download_private/
Disallow /auth/
Disallow /auth.php
Disallow /personal/
Disallow /communication/forum/user/
Disallow /e-store/paid/detail.php
Disallow /e-store/affiliates/
Disallow /club/$
Disallow /club/messages/
Disallow /club/log/
Disallow /content/board/my/
Disallow /content/links/my/
Disallow /*/search/
Disallow /*PAGE_NAME%3Dsearch
Disallow /*PAGE_NAME%3Duser_post
Disallow /*PAGE_NAME%3Ddetail_slide_show
Disallow /*/slide_show/
Disallow /*/gallery/*order%3D*
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*action%3DADD_TO_COMPARE_LIST
Disallow /*action%3DDELETE_FROM_COMPARE_LIST
Disallow /*action%3DADD2BASKET
Disallow /*action%3DBUY
Disallow /*print_course%3DY
Disallow /*bitrix_*%3D
Disallow /*backurl%3D*
Disallow /*BACKURL%3D*
Disallow /*back_url%3D*
Disallow /*BACK_URL%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$

googlebot

Rule Path
Disallow /Google

googlebot-news

Rule Path
Disallow /Google

googlebot-image

Rule Path
Disallow /Google

googlebot-video

Rule Path
Disallow /Google

googlebot-mobile

Rule Path
Disallow /Google

adidxbot

Rule Path
Disallow /Bing

adsbot-google

Rule Path
Disallow /Google

aolbuild

Rule Path
Disallow /AOL

applebot

Rule Path
Disallow /Apple

bing

Rule Path
Disallow /Bing

bingbot

Rule Path
Disallow /Bing

bingpreview

Rule Path
Disallow /Bing

developers.facebook.com

Rule Path
Disallow /Facebook

docomo

Rule Path
Disallow /DoCoMo

duckduckgo

Rule Path
Disallow /DuckDuckGo

facebookexternalhit

Rule Path
Disallow /Facebook

facebookplatform

Rule Path
Disallow /Facebook

feedfetcher-google

Rule Path
Disallow /Google

google-http-java-client

Rule Path
Disallow /Google

googlebot test

Rule Path
Disallow /Google

gsa-crawler

Rule Path
Disallow /Google

linkedinbot

Rule Path
Disallow /LinkedIn

mediapartners-google

Rule Path
Disallow /Google

msnbot

Rule Path
Disallow /Bing

msnbot-media

Rule Path
Disallow /Bing

slackbot

Rule Path
Disallow /Slack

slackbot-linkexpanding

Rule Path
Disallow /Slack

slurp

Rule Path
Disallow /Yahoo

twitterbot

Rule Path
Disallow /Twitter

yahoo

Rule Path
Disallow /Yahoo