bankstore.com.ua
robots.txt

Robots Exclusion Standard data for bankstore.com.ua

Resource Scan

Scan Details

Site Domain bankstore.com.ua
Base Domain bankstore.com.ua
Scan Status Ok
Last Scan2024-06-27T21:49:20+00:00
Next Scan 2024-07-04T21:49:20+00:00

Last Scan

Scanned2024-06-27T21:49:20+00:00
URL http://bankstore.com.ua/robots.txt
Redirect http://www.bankstore.com.ua/robots.txt
Redirect Domain www.bankstore.com.ua
Redirect Base bankstore.com.ua
Domain IPs 212.66.44.50
Redirect IPs 212.66.44.50
Response IP 212.66.44.50
Found Yes
Hash a49ecc4d38517bf65c503f218c097b684be2927374b35e2e1681b124f00fb3b9
SimHash 233ca6f26efc

Groups

wotbox

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

setlinksbot

Rule Path
Disallow /

setlinks

Rule Path
Disallow /

ttcorebot

Rule Path
Disallow /

synapse

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

metaspider

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

tasbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

peerindex

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

slurp

Rule Path
Disallow /

aport

Rule Path
Disallow /

ning

Rule Path
Disallow /

js-kit

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

java

Rule Path
Disallow /

commentreader

Rule Path
Disallow /

yeti

Rule Path
Disallow /

discobot

Rule Path
Disallow /

btwebclient

Rule Path
Disallow /

tagoobot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

igdespyder

Rule Path
Disallow /

teleport

Rule Path
Disallow /

offline

Rule Path
Disallow /

disco

Rule Path
Disallow /

netvampire

Rule Path
Disallow /

copier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

stolencamerafinder

Rule Path
Disallow /

googlebot

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /editor/
Disallow /help/
Disallow /images/
Disallow /includes/
Disallow /language/
Disallow /mambots/
Disallow /media/
Disallow /modules/
Disallow /installation/

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /editor/
Disallow /help/
Disallow /images/
Disallow /includes/
Disallow /language/
Disallow /mambots/
Disallow /media/
Disallow /modules/
Disallow /installation/

Other Records

Field Value
crawl-delay 1

yandexbot

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /editor/
Disallow /help/
Disallow /images/
Disallow /includes/
Disallow /language/
Disallow /mambots/
Disallow /media/
Disallow /modules/
Disallow /installation/

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /editor/
Disallow /help/
Disallow /images/
Disallow /includes/
Disallow /language/
Disallow /mambots/
Disallow /media/
Disallow /modules/
Disallow /installation/

Other Records

Field Value
crawl-delay 5

Warnings

  • 2 invalid lines.
  • `host` is not a known field.