wildberries.kg
robots.txt

Robots Exclusion Standard data for wildberries.kg

Resource Scan

Scan Details

Site Domain wildberries.kg
Base Domain wildberries.kg
Scan Status Ok
Last Scan2024-09-21T15:38:58+00:00
Next Scan 2024-10-05T15:38:58+00:00

Last Scan

Scanned2024-09-21T15:38:58+00:00
URL https://wildberries.kg/robots.txt
Redirect https://www.wildberries.kg/robots.txt
Redirect Domain www.wildberries.kg
Redirect Base wildberries.kg
Domain IPs 185.138.253.40, 185.138.255.40, 213.184.155.68
Redirect IPs 185.138.253.4, 185.138.255.4, 213.184.155.140
Response IP 185.138.255.4
Found Yes
Hash 1f0e785b04bb1989f133caef8b640e0c52f9a2ef5201a48ef3c855017f5603c4
SimHash 6b4ed3e24f83

Groups

yandex

Rule Path
Allow /*?page=
Allow /*?sle=
Allow /*?direct=
Allow /*detail.aspx*?wb_tp=
Allow /*detail.aspx*%26wb_tp%3D
Allow /*detail.aspx*?wb_bnd=
Allow /*detail.aspx*%26wb_bnd%3D
Disallow /*?*
Disallow /lk
Disallow /security
Disallow /cabinet/
Disallow /users/
Disallow /profile/
Disallow /sale/
Disallow /ScriptResource.axd
Disallow /axord/Modal/
Disallow /wildberries/templates/
Disallow /wildberries/JavaScripts/
Disallow /wildberries/services_page/
Disallow /catalog/1/search.aspx
Disallow /fpage/js/
Disallow /*kvit2.aspx
Disallow /*order.aspx
Disallow /*search
Disallow /*w_detail.aspx
Disallow /*m_detail.aspx
Disallow /*details.aspx
Disallow /*brands.aspx
Disallow /*_about
Disallow /*ClientInfo.aspx
Disallow /MailFriend
Disallow /%5C
Disallow /services/proverka-sovmestimosti
Disallow /services/sertifikaty
Disallow /services/feedback
Disallow /services/rss
Disallow /catalog/vybor-pokupateley/*

*

Rule Path
Allow /*?page=
Allow /*?sle=
Allow /*?direct=
Allow /*detail.aspx*?wb_tp=
Allow /*detail.aspx*%26wb_tp%3D
Allow /*detail.aspx*?wb_bnd=
Allow /*detail.aspx*%26wb_bnd%3D
Disallow /*?*
Disallow /lk
Disallow /security
Disallow /cabinet/
Disallow /users/
Disallow /profile/
Disallow /sale/
Disallow /ScriptResource.axd
Disallow /axord/Modal/
Disallow /wildberries/templates/
Disallow /wildberries/JavaScripts/
Disallow /wildberries/services_page/
Disallow /catalog/1/search.aspx
Disallow /fpage/js/
Disallow /*kvit2.aspx
Disallow /*order.aspx
Disallow /*search
Disallow /*w_detail.aspx
Disallow /*m_detail.aspx
Disallow /*details.aspx
Disallow /*brands.aspx
Disallow /*_about
Disallow /*ClientInfo.aspx
Disallow /MailFriend
Disallow /%5C
Disallow /services/proverka-sovmestimosti
Disallow /services/sertifikaty
Disallow /services/feedback
Disallow /services/rss
Disallow /catalog/vybor-pokupateley/*

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.