Log In Sign Up

bigon.sk
robots.txt

Robots Exclusion Standard data for bigon.sk

Resource Scan

Scan Details

Site Domain bigon.sk
Base Domain bigon.sk
Scan Status Ok
Last Scan2025-10-27T08:08:24+00:00
Next Scan 2025-11-26T08:08:24+00:00

Last Scan

Scanned2025-10-27T08:08:24+00:00
URL https://bigon.sk/robots.txt
Domain IPs 109.105.63.60
Response IP 109.105.63.60
Found Yes
Hash 00a6b6784200cbb82fbac726a735cc18023db245fe077afa624853891059adc5
SimHash 4a946051c459

Groups

*

Rule Path
Disallow /*stifulltext_search
Disallow /*scaid
Disallow /*setstiordercook
Disallow /*setstishowstyle
Disallow /*stifavourites
Disallow /*stionstore
Disallow /*stiparcomp
Disallow /*stirating
Disallow /*stishowtype
Disallow /*stiwatchdog
Disallow /*ordbaskets
Disallow /*orderby
Disallow /*onstocki
Disallow /*onstockiqud
Disallow /*pagesize
Disallow /*_jx.asp
Disallow /print.asp
Disallow /default.asp?*action=

ahrefsbot

Rule Path
Disallow /

aliyunsecbot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applewebkit

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

botnet

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

dognetbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

eurolixbot

Rule Path
Disallow /

ekaufbot-stela

Rule Path
Disallow /

exabot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

fastcrawler

Rule Path
Disallow /

firephp

Rule Path
Disallow /

firmograph

Rule Path
Disallow /

fullstorybot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

gloomarbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

hanaleibot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

komodiabot

Rule Path
Disallow /

konturbot

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

linguee.com

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

magpie

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mdbotdl

Rule Path
Disallow /

mergadobot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

mybot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

opensiteexplorer

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

owler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pimeyes

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

qwantbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

riddler

Rule Path
Disallow /

ru_bot

Rule Path
Disallow /

sbintuitionsbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

searchatlas

Rule Path
Disallow /

searchbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

shm-bot

Rule Path
Disallow /

shoptetbot

Rule Path
Disallow /

slack-imgproxy

Rule Path
Disallow /

slurp

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spbot

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

stormcrawler

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

wpbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages*

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

microsoftpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.bigon.sk//sitemap/sitemap_index.xml
Back to top

Comments

  • blocking robots
  • restriction
  • sitemap
Back to top