Log In Sign Up

veslo.ru
robots.txt

Robots Exclusion Standard data for veslo.ru

Resource Scan

Scan Details

Site Domain veslo.ru
Base Domain veslo.ru
Scan Status Ok
Last Scan2024-10-28T07:04:03+00:00
Next Scan 2024-11-27T07:04:03+00:00

Last Scan

Scanned2024-10-28T07:04:03+00:00
URL http://veslo.ru/robots.txt
Domain IPs 93.191.11.42
Response IP 93.191.11.42
Found Yes
Hash 3186fbabcfca929febbb537e8fb104e486415c08edde7044c88f3e202b7ccebf
SimHash 17d7c242a18e

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /banner/
Disallow /accesswatch/
Disallow /img/
Disallow /panda/
Disallow /fotos/
Disallow /eco/
Disallow /banner/
Disallow /album/
Disallow /2001/baza/ring/
Disallow /2001/baza/mini.asp
Disallow /pogoda_mini.asp
Disallow /region.asp
Disallow /expvodot.asp
Disallow /forum/archive/
Disallow /forum/archive/index.php
Disallow /forum/clientscript/jquery/
Disallow /forum/clientscript/
Disallow /forum/cpstyles/
Disallow /forum/customavatars/
Disallow /forum/customgroupicons/
Disallow /forum/customprofilepics/
Disallow /forum/forumruner/
Disallow /forum/includes/
Disallow /forum/mobiquo/
Disallow /forum/packages/
Disallow /forum/photo/
Disallow /forum/images/
Disallow /forum/signaturepics/
Disallow /forum/styles/
Disallow /forum/vb/
Disallow /forum/ajax.php
Disallow /forum/printthread.php
Disallow /forum/attachment.php
Disallow /forum/calendar.php
Disallow /forum/cron.php
Disallow /forum/editpost.php
Disallow /forum/global.php
Disallow /forum/image.php
Disallow /forum/inlinemod.php
Disallow /forum/joinrequests.php
Disallow /forum/login.php
Disallow /forum/member.php
Disallow /forum/memberlist.php
Disallow /forum/misc.php
Disallow /forum/moderator.php
Disallow /forum/newattachment.php
Disallow /forum/newreply.php
Disallow /forum/newthread.php
Disallow /forum/online.php
Disallow /forum/poll.php
Disallow /forum/postings.php
Disallow /forum/printthread.php
Disallow /forum/private.php
Disallow /forum/profile.php
Disallow /forum/register.php
Disallow /forum/report.php
Disallow /forum/reputation.php
Disallow /forum/search.php
Disallow /forum/sendmessage.php
Disallow /forum/showgroups.php
Disallow /forum/subscription.php
Disallow /forum/threadrate.php
Disallow /forum/usercp.php
Disallow /forum/usernote.php
Disallow /forum/forumdisplay.php?do=markread
Disallow /forum/dbtgallery.php?gal=*&do=add_album
Disallow /forum/dbtgallery.php?gal=*&do=add_image
Disallow /forum/dbtgallery.php?gal=*&do=add_prof_image

ahrefsbot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

java

Rule Path
Disallow /

njuicebot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

crawler

Rule Path
Disallow /

js-kit

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

postrank

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

aport

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

libwww

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

sweb

Rule Path
Disallow /

linkexchanger

Rule Path
Disallow /

soup

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

internetseer

Rule Path
Disallow /

bubing

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

yeti

Rule Path
Disallow /

birubot

Rule Path
Disallow /

yottosbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

purebot

Rule Path
Disallow /

kmsearchbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

camontspider

Rule Path
Disallow /

ptd-crawler

Rule Path
Disallow /

httrack

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

ttcrawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

slurp

Rule Path
Disallow /

zeus

Rule Path
Disallow /

abonti

Rule Path
Disallow /

aggregator

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aport

Rule Path
Disallow /

asterias

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

birubot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bullseye

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

camontspider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cegbfeieh

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

crawler

Rule Path
Disallow /

crescent

Rule Path
Disallow /

deusu

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

feedbooster

Rule Path
Disallow /

foobot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

harvest

Rule Path
Disallow /

hloader

Rule Path
Disallow /

httplib

Rule Path
Disallow /

httrack

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ieautodiscovery

Rule Path
Disallow /

incutio

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

internetseer

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

java

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

js-kit

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

kenjin spider

Rule Path
Disallow /

kmsearchbot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

libweb

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linkexchanger

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linko

Rule Path
Disallow /

linkscan/8\.1a unix

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

lmspider

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

magpie

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

mippin

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

moget

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

netants

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

njuicebot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

olecrawler

Rule Path
Disallow /

openfind

Rule Path
Disallow /

postrank

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

ptd-crawler

Rule Path
Disallow /

purebot

Rule Path
Disallow /

queryn metasearch

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

riddler

Rule Path
Disallow /

rma

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

serf

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

serpstat

Rule Path
Disallow /

slurp

Rule Path
Disallow /

snappreviewbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

soup

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

sweb

Rule Path
Disallow /

szukacz/1\.4

Rule Path
Disallow /

teleport

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

titan

Rule Path
Disallow /

tocrawl/urldispatcher

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

ttcrawler

Rule Path
Disallow /

turingos

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unknown

Rule Path
Disallow /

uptime files

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

user-agent

Rule Path
Disallow /

vci

Rule Path
Disallow /

vedma

Rule Path
Disallow /

voyager

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

website quester

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yottosbot

Rule Path
Disallow /

zao

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwant

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

riddler

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazonbot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

vkrobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

gptbot/1.0

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

facebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

yandexrenderresourcesbot/1.0

Rule Path
Disallow /

yandexrenderresourcesbot

Rule Path
Disallow /

pinterestbot/1.0

Rule Path
Disallow /

statdom.ru/bot

Rule Path
Disallow /

brokenlinkcheck.com/1.2

Rule Path
Disallow /

brokenlinkcheck

Rule Path
Disallow /

claudebot/1.0

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

dataforseo-bot

Rule Path
Disallow /

dataforseo.com

Rule Path
Disallow /

trident

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /
Back to top

Comments

  • Disallow: /outdoor/
  • Disallow: /2001/baza/fore.asp
  • Disallow: /pogoda.asp
  • Disallow: /pogoda2.asp
  • User-agent: yandexbot накрылся поиск по сайту!
  • Disallow: /
  • User-agent: yandexbot не работает обÑ
  • Crawl-delay: 10
  • User-agent: Googlebot пока не сильно лезет - на банить
  • Crawl-delay: 30
  • User-agent: Googlebot
  • Disallow: /
  • User-agent: YandexBot/3.0
  • Disallow: /
  • User-agent: YandexImages
  • Disallow: /
  • бот ниже обÑ
  • User-agent: Yandex
  • Clean-param: t /forum/showthread.php
  • Clean-param: viewfull /forum/showthread.php
  • Clean-param: tab /forum/member.php
  • Clean-param: type /forum/member.php
Back to top

Warnings

  • 2 invalid lines.
  • `clean-param` is not a known field.
Back to top