reshebniki.org.ua
robots.txt

Robots Exclusion Standard data for reshebniki.org.ua

Resource Scan

Scan Details

Site Domain reshebniki.org.ua
Base Domain reshebniki.org.ua
Scan Status Ok
Last Scan2024-09-24T20:59:27+00:00
Next Scan 2024-10-01T20:59:27+00:00

Last Scan

Scanned2024-09-24T20:59:27+00:00
URL https://reshebniki.org.ua/robots.txt
Domain IPs 91.234.32.10
Response IP 91.234.32.10
Found Yes
Hash 74ce5949a3a4ddfb768948250710c0681d9bdc3b4f61ef93d7a4ffb763353962
SimHash 7a3c235be6b3

Groups

*

Rule Path
Allow /
Disallow /*print
Disallow /*userinfo
Disallow /2011/
Disallow /2012/
Disallow /2013/
Disallow /2014/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2018/
Disallow /lastnews/
Disallow /index.php?subaction=userinfo
Disallow /autobackup.php
Disallow /user/
Disallow /favorites/
Disallow /index.php?do=register
Disallow /?do=lastcomments
Disallow /statistics.html
Disallow /index.php?do=addnews
Disallow /index.php?do=feedback
Disallow /index.php?do=lostpassword
Disallow /index.php?do=pm
Disallow /index.php?do=stats
Disallow /index.php?do=search
Disallow /index.php?subaction=newposts
Disallow /index.php?do=rules
Disallow /?do=tags
Disallow /tags/
Disallow /page/*/
Disallow /?qdr=*

Other Records

Field Value
crawl-delay 5

addthis

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

alexabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

amznkassocbot/4.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

baidu

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

baiduspider-image

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bdcbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bdcbot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bsalsa

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

butterfly

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ccbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

changedetection

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

coccoc

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

crazywebcrawler-spider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

daumoa

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

docomo/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

easouspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

exabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ezooms

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

findxbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

findxbot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

flipboard

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

genieo

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

gluten free crawler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

grapeshot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

haosouspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

hypercrawl

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ichiro

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ichiro/3.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ichiro/4.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

infoweb

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

istellabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

libwww-perl

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

linguee bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

linkdexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

linkdexbot/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

linkdexbot/2.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

linkdexbot/2.2

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

linkpadbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ltx71

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

meanpathbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

megaindex.ru/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

naverbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

nerdybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

netseer

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

nutch bots

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

obot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

paperlibot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

phpservermon/3.1.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

privacyawarebot/1.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

proximic

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

psbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

queryseekerspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

qwantify

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

rogerbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

screenerbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

searchmetricsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sf/2 (skipfish)

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

siteexplorer

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sogou head spider/3.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sogou orion spider/3.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sogou pic agent

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sogou pic spider/3.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sputnikbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sunrise

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

surdotlybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

surdotlybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

swiftbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

tdjbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

trovitbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

turnitinbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

tweetmeme

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

tweetmemebot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

twengabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

twengabot-2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

twengabot-discover

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

twengabot/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

unwindfetchor

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

uptimebot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

uptimebot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

uptimerobot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

uptimerobot/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

voltron

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

wbsearchbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

wesee

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

wget

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

wget

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

wotbox

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

xovibot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

y! j-asr

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yacybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yeti

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yodaobot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yoozbot-2.2

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

youdaobot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yahoo! slurp

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yahoo-slurp

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

anews/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

anews

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

kribrum

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

kribrum/0.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

iskanie

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

paperlibot/2.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

special_archiver/3.1.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

special_archiver

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ccbot/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

exabot/3.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

semrushbot/1.1~bl

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

semrushbot/1.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

semrushbot-sa/0.97

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

um-fc

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

um-fc/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

um-ln

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

um-ln/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

heritrix

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

deusu/5.0.2

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bitlybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bitlybot/3.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

maxpointcrawler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

getintent crawler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

scrapy

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

scrapy/1.2.2

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

twitterbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

twitterbot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sputnikbot/2.3

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

trident/6.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

trident/5.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

trident

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

guzzlehttp/6.1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

guzzlehttp

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

x11

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bingbot/2.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

stackrambler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

metaspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

aport

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

scooter

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

trendictionbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

trendictionbot0.5.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

kraken

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

kraken/0.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

dotbot/1.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bubing

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

yeti/1.1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

seznambot/3.2

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

webartexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

blexbot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

spbot/5.0.3

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

spbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

um-ic

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

um-ic/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

germcrawler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

sogou

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

gingercrawler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

nutch

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

urlbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

scoutjet

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

grouphigh

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

grouphigh/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.4.3

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.4.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.2.4

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.2.3

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.0.8

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.0.7

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.0.6

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.0.5

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.4.5

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.4.6

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.4.7

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mj12bot/v1.4.8

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

rogerbot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

rogerbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

megaindex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

megaindex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

crawler4j

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

steeler/3.5

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

steeler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

serpstatbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

boitho

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://reshebniki.org.ua/sitemap.xml

Warnings

  • 18 invalid lines.
  • `host` is not a known field.