bershka.net
robots.txt

Robots Exclusion Standard data for bershka.net

Archived Snapshots

Resource Scan

Scan Details

Site Domain	bershka.net
Base Domain	bershka.net
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a server error.
Last Scan	2024-08-19T23:27:44+00:00
Next Scan	2024-11-17T23:27:44+00:00

Last Successful Scan

Scanned	2022-02-07T08:26:38+00:00
URL	http://www.bershka.net/robots.txt
Redirect	https://www.bershka.com/robots.txt
Redirect Domain	www.bershka.com
Redirect Base	bershka.com
Response IP	23.200.74.104
Found	Yes
Hash	b3a577d49f354722ac363e6c072e4a5dba21b72daa8b79af325398fcb5895da9
SimHash	a0d05f134096

Groups

ubicrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

doc

Rule	Path
Disallow	/

Rule

Path

Disallow

zao

Rule	Path
Disallow	/

Rule

Path

Disallow

sitecheck.internetseer.com

Rule	Path
Disallow	/

Rule

Path

Disallow

zealbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msiecrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

sitesnagger

Rule	Path
Disallow	/

Rule

Path

Disallow

webstripper

Rule	Path
Disallow	/

Rule

Path

Disallow

webcopier

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch

Rule	Path
Disallow	/

Rule

Path

Disallow

offline explorer

Rule	Path
Disallow	/

Rule

Path

Disallow

teleport

Rule	Path
Disallow	/

Rule

Path

Disallow

teleportpro

Rule	Path
Disallow	/

Rule

Path

Disallow

webzip

Rule	Path
Disallow	/

Rule

Path

Disallow

linko

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

microsoft.url.control

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu

Rule	Path
Disallow	/

Rule

Path

Disallow

larbin

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww

Rule	Path
Disallow	/

Rule

Path

Disallow

zyborg

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

fast

Rule	Path
Disallow	/

Rule

Path

Disallow

maxthon

Rule	Path
Disallow	/

Rule

Path

Disallow

cncdialer

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	//user-account.html
Disallow	//user-orders.html
Disallow	//my-account-returns.html
Disallow	//ajax-logon.html
Disallow	//ajax-user-registration.html
Disallow	//reset-password.html
Disallow	//checkout.html
Disallow	//order-confirmation.html
Disallow	/webapp/wcs/stores//home
Disallow	/webapp/wcs/stores//CategoryPage
Disallow	/webapp/wcs/stores//ItxStandardStoreLocatorPage
Disallow	/webapp/wcs/stores//ProductPage
Disallow	/webapp/wcs/stores/mobile/*
Disallow	//q/
Disallow	/?query=
Disallow	/?searchTerm=
Disallow	/?search=
Disallow	/price%3D
Disallow	/discount%3D
Disallow	/size%3D
Disallow	/%3D%7C%7C*
Disallow	/sort%3D
Disallow	/*wish-list.html
Disallow	/be_sorteo.html
Disallow	/itxrest
Allow	//q/index%3D1*

Rule

Path

Disallow

/*/user-account.html*

Disallow

/*/user-orders.html*

Disallow

/*/my-account-returns.html*

Disallow

/*/ajax-logon.html*

Disallow

/*/ajax-user-registration.html*

Disallow

/*/reset-password.html*

Disallow

/*/checkout.html*

Disallow

/*/order-confirmation.html*

Disallow

/webapp/wcs/stores/*/home*

Disallow

/webapp/wcs/stores/*/CategoryPage*

Disallow

/webapp/wcs/stores/*/ItxStandardStoreLocatorPage*

Disallow

/webapp/wcs/stores/*/ProductPage*

Disallow

/webapp/wcs/stores/mobile/*

Disallow

/*/q/*

Disallow

/*?query=*

Disallow

/*?searchTerm=*

Disallow

/*?search=*

Disallow

/*price%3D*

Disallow

/*discount%3D*

Disallow

/*size%3D*

Disallow

/*%3D*%7C%7C*

Disallow

/*sort%3D*

Disallow

/*wish-list.html

Disallow

/*be_sorteo.html*

Disallow

/itxrest

Allow

/*/q/*index%3D1*

yandex

Rule	Path
Disallow	/
Allow	/ru/*
Allow	/ua/*
Allow	/kz/*
Allow	/by/*
Allow	/tr/*
Allow	/pl/*
Allow	/ee/*
Allow	/lv/*

Rule

Path

Disallow

Allow

/ru/*

Allow

/ua/*

Allow

/kz/*

Allow

/by/*

Allow

/tr/*

Allow

/pl/*

Allow

/ee/*

Allow

/lv/*

*

Rule	Path
Disallow	/dz/en/
Disallow	/ad/en/
Disallow	/at/en/
Disallow	/by/en/
Disallow	/be/en/
Disallow	/bg/en/
Disallow	/co/en/
Disallow	/cr/en/
Disallow	/hr/en/
Disallow	/cz/en/
Disallow	/dk/en/
Disallow	/do/en/
Disallow	/ec/en/
Disallow	/sv/en/
Disallow	/es/en/
Disallow	/ic/en/
Disallow	/ee/en/
Disallow	/fi/en/
Disallow	/fr/en/
Disallow	/de/en/
Disallow	/gr/en/
Disallow	/gt/en/
Disallow	/hn/en/
Disallow	/hu/en/
Disallow	/it/en/
Disallow	/jp/en/
Disallow	/kz/en/
Disallow	/lv/en/
Disallow	/lt/en/
Disallow	/lu/en/
Disallow	/ma/en/
Disallow	/mx/en/
Disallow	/nl/en/
Disallow	/ni/en/
Disallow	/pa/en/
Disallow	/pl/en/
Disallow	/pt/en/
Disallow	/ro/en/
Disallow	/ru/en/
Disallow	/sk/en/
Disallow	/si/en/
Disallow	/se/en/
Disallow	/ch/en/
Disallow	/tr/en/
Disallow	/ve/en/
Disallow	/ww/es/
Disallow	/ma/es/
Disallow	/ad/fr/
Disallow	/ww/fr/
Disallow	/eg/fr/
Disallow	/lb/fr/
Disallow	/om/fr/
Disallow	/ch/fr/
Disallow	/ad/ca/
Disallow	/ww/pt/
Disallow	/ii/
Disallow	/ic/

Rule

Path

Disallow

/dz/en/

Disallow

/ad/en/

Disallow

/at/en/

Disallow

/by/en/

Disallow

/be/en/

Disallow

/bg/en/

Disallow

/co/en/

Disallow

/cr/en/

Disallow

/hr/en/

Disallow

/cz/en/

Disallow

/dk/en/

Disallow

/do/en/

Disallow

/ec/en/

Disallow

/sv/en/

Disallow

/es/en/

Disallow

/ic/en/

Disallow

/ee/en/

Disallow

/fi/en/

Disallow

/fr/en/

Disallow

/de/en/

Disallow

/gr/en/

Disallow

/gt/en/

Disallow

/hn/en/

Disallow

/hu/en/

Disallow

/it/en/

Disallow

/jp/en/

Disallow

/kz/en/

Disallow

/lv/en/

Disallow

/lt/en/

Disallow

/lu/en/

Disallow

/ma/en/

Disallow

/mx/en/

Disallow

/nl/en/

Disallow

/ni/en/

Disallow

/pa/en/

Disallow

/pl/en/

Disallow

/pt/en/

Disallow

/ro/en/

Disallow

/ru/en/

Disallow

/sk/en/

Disallow

/si/en/

Disallow

/se/en/

Disallow

/ch/en/

Disallow

/tr/en/

Disallow

/ve/en/

Disallow

/ww/es/

Disallow

/ma/es/

Disallow

/ad/fr/

Disallow

/ww/fr/

Disallow

/eg/fr/

Disallow

/lb/fr/

Disallow

/om/fr/

Disallow

/ch/fr/

Disallow

/ad/ca/

Disallow

/ww/pt/

Disallow

/ii/

Disallow

/ic/

*

Rule	Path
Disallow	/103138775
Disallow	/103138821
Disallow	/103272682
Disallow	/103284521
Disallow	/103284515
Disallow	/103284632
Disallow	/103333869
Disallow	/103333875
Disallow	/103159573
Disallow	/103293405
Disallow	/103138779
Disallow	/103138826
Disallow	/103272684
Disallow	/103284523
Disallow	/103284517
Disallow	/103284633
Disallow	/103333871
Disallow	/103333878
Disallow	/103159574
Disallow	/103293406

Rule

Path

Disallow

/*103138775*

Disallow

/*103138821*

Disallow

/*103272682*

Disallow

/*103284521*

Disallow

/*103284515*

Disallow

/*103284632*

Disallow

/*103333869*

Disallow

/*103333875*

Disallow

/*103159573*

Disallow

/*103293405*

Disallow

/*103138779*

Disallow

/*103138826*

Disallow

/*103272684*

Disallow

/*103284523*

Disallow

/*103284517*

Disallow

/*103284633*

Disallow

/*103333871*

Disallow

/*103333878*

Disallow

/*103159574*

Disallow

/*103293406*

*

Rule	Path
Disallow	/al/-c0p*.html
Disallow	/al/-c1p*.html
Disallow	/am/-c0p*.html
Disallow	/am/-c1p*.html
Disallow	/az/-c0p*.html
Disallow	/az/-c1p*.html
Disallow	/ba/-c0p*.html
Disallow	/ba/-c1p*.html
Disallow	/bh/-c0p*.html
Disallow	/bh/-c1p*.html
Disallow	/by/-c0p*.html
Disallow	/by/-c1p*.html
Disallow	/cr/-c0p*.html
Disallow	/cr/-c1p*.html
Disallow	/cy/-c0p*.html
Disallow	/cy/-c1p*.html
Disallow	/do/-c0p*.html
Disallow	/do/-c1p*.html
Disallow	/dz/-c0p*.html
Disallow	/dz/-c1p*.html
Disallow	/ec/-c0p*.html
Disallow	/ec/-c1p*.html
Disallow	/ge/-c0p*.html
Disallow	/ge/-c1p*.html
Disallow	/gt/-c0p*.html
Disallow	/gt/-c1p*.html
Disallow	/hk/-c0p*.html
Disallow	/hk/-c1p*.html
Disallow	/hn/-c0p*.html
Disallow	/hn/-c1p*.html
Disallow	/jo/-c0p*.html
Disallow	/jo/-c1p*.html
Disallow	/kz/-c0p*.html
Disallow	/kz/-c1p*.html
Disallow	/lb/-c0p*.html
Disallow	/lb/-c1p*.html
Disallow	/me/-c0p*.html
Disallow	/me/-c1p*.html
Disallow	/mk/-c0p*.html
Disallow	/mk/-c1p*.html
Disallow	/mo/-c0p*.html
Disallow	/mo/-c1p*.html
Disallow	/my/-c0p*.html
Disallow	/my/-c1p*.html
Disallow	/ni/-c0p*.html
Disallow	/ni/-c1p*.html
Disallow	/om/-c0p*.html
Disallow	/om/-c1p*.html
Disallow	/pa/-c0p*.html
Disallow	/pa/-c1p*.html
Disallow	/ph/-c0p*.html
Disallow	/ph/-c1p*.html
Disallow	/sg/-c0p*.html
Disallow	/sg/-c1p*.html
Disallow	/sv/-c0p*.html
Disallow	/sv/-c1p*.html
Disallow	/th/-c0p*.html
Disallow	/th/-c1p*.html
Disallow	/tw/-c0p*.html
Disallow	/tw/-c1p*.html
Disallow	/ve/-c0p*.html
Disallow	/ve/-c1p*.html
Disallow	/xk/-c0p*.html
Disallow	/xk/-c1p*.html

Rule

Path

Disallow

/al/*-c0*p*.html

Disallow

/al/*-c1*p*.html

Disallow

/am/*-c0*p*.html

Disallow

/am/*-c1*p*.html

Disallow

/az/*-c0*p*.html

Disallow

/az/*-c1*p*.html

Disallow

/ba/*-c0*p*.html

Disallow

/ba/*-c1*p*.html

Disallow

/bh/*-c0*p*.html

Disallow

/bh/*-c1*p*.html

Disallow

/by/*-c0*p*.html

Disallow

/by/*-c1*p*.html

Disallow

/cr/*-c0*p*.html

Disallow

/cr/*-c1*p*.html

Disallow

/cy/*-c0*p*.html

Disallow

/cy/*-c1*p*.html

Disallow

/do/*-c0*p*.html

Disallow

/do/*-c1*p*.html

Disallow

/dz/*-c0*p*.html

Disallow

/dz/*-c1*p*.html

Disallow

/ec/*-c0*p*.html

Disallow

/ec/*-c1*p*.html

Disallow

/ge/*-c0*p*.html

Disallow

/ge/*-c1*p*.html

Disallow

/gt/*-c0*p*.html

Disallow

/gt/*-c1*p*.html

Disallow

/hk/*-c0*p*.html

Disallow

/hk/*-c1*p*.html

Disallow

/hn/*-c0*p*.html

Disallow

/hn/*-c1*p*.html

Disallow

/jo/*-c0*p*.html

Disallow

/jo/*-c1*p*.html

Disallow

/kz/*-c0*p*.html

Disallow

/kz/*-c1*p*.html

Disallow

/lb/*-c0*p*.html

Disallow

/lb/*-c1*p*.html

Disallow

/me/*-c0*p*.html

Disallow

/me/*-c1*p*.html

Disallow

/mk/*-c0*p*.html

Disallow

/mk/*-c1*p*.html

Disallow

/mo/*-c0*p*.html

Disallow

/mo/*-c1*p*.html

Disallow

/my/*-c0*p*.html

Disallow

/my/*-c1*p*.html

Disallow

/ni/*-c0*p*.html

Disallow

/ni/*-c1*p*.html

Disallow

/om/*-c0*p*.html

Disallow

/om/*-c1*p*.html

Disallow

/pa/*-c0*p*.html

Disallow

/pa/*-c1*p*.html

Disallow

/ph/*-c0*p*.html

Disallow

/ph/*-c1*p*.html

Disallow

/sg/*-c0*p*.html

Disallow

/sg/*-c1*p*.html

Disallow

/sv/*-c0*p*.html

Disallow

/sv/*-c1*p*.html

Disallow

/th/*-c0*p*.html

Disallow

/th/*-c1*p*.html

Disallow

/tw/*-c0*p*.html

Disallow

/tw/*-c1*p*.html

Disallow

/ve/*-c0*p*.html

Disallow

/ve/*-c1*p*.html

Disallow

/xk/*-c0*p*.html

Disallow

/xk/*-c1*p*.html

Other Records

Field	Value
sitemap	https://www.bershka.com/sitemap/sitemap_indice.xml.gz

Field

Value

sitemap

https://www.bershka.com/sitemap/sitemap_indice.xml.gz

Comments

BSKBSKBSKMBSk dMN BSk
BSK dBSKm bsk BSk
BSK BSK bsk BSk
BSK NMN mNBSkBSkd bsk mNBSk BSKNMMBSk bskdNBSkBSk BSk dNMm dNNBSkBSkd
BERSHKAdmNBSK dBSK dNMm bskNBSk BSK dNN bskNd BSK BSk NMNd dMNd dBSK
BERSHKAKNBSkd NMm bsk bskN BSKb bsk bsk BSk BSKm ddNMm
BSK dNMN BSKBERNATSBSk bsk BSKSERGIk bsk bsk BERSHKAm dmNBERSHKA
BSK BSK BSk bsk ddmNBSK bsk bsk BERSHKASK bskNd NMm
BSK dBSK NMN d bsk bsk bsk bsk BSK dBSK BSk NMm
BSKddddddmNBSk NMNd dBSKd bsk dBSKd dNMN bsk bsk BSk dBSK BSKd dmNBSk
BSKBSKBSKNmm dmNBSKMNm dNN mBERSHKAd bsk dNN NNd NNm mNBSKBSkdNN
Bad bots, bad bots
Whatcha gonna do, whatcha gonna do
When they come for you
URLs we don't want to index
Yandex must crawl only countries where they have presence
Disallow secondary languages
Disallow IC
URLs we don't want to index (PP)
Disallow PDP in countries where we don't sell

bershka.netrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

ubicrawler

doc

zao

sitecheck.internetseer.com

zealbot

msiecrawler

sitesnagger

webstripper

webcopier

fetch

offline explorer

teleport

teleportpro

webzip

linko

httrack

microsoft.url.control

xenu

larbin

libwww

zyborg

download ninja

fast

maxthon

cncdialer

mj12bot

*

yandex

*

*

*

Other Records

Comments

bershka.net
robots.txt