wildberries.by
robots.txt

Robots Exclusion Standard data for wildberries.by

Resource Scan

Scan Details

Site Domain wildberries.by
Base Domain wildberries.by
Scan Status Ok
Last Scan2024-06-14T14:43:26+00:00
Next Scan 2024-06-28T14:43:26+00:00

Last Scan

Scanned2024-06-14T14:43:26+00:00
URL https://wildberries.by/robots.txt
Redirect https://www.wildberries.by/robots.txt
Redirect Domain www.wildberries.by
Redirect Base wildberries.by
Domain IPs 185.179.80.73
Redirect IPs 185.179.80.73
Response IP 185.179.80.73
Found Yes
Hash 7c61b3510d108ac85fe034d385cea5738dd1173cc0dac8db9119ba1b714a7303
SimHash 770458c03f55

Groups

yandex

Rule Path
Disallow /*basket
Disallow /*profile
Disallow /*sort%3D*
Disallow /*pagesize%3D*
Disallow /*targetUrl%3D*
Disallow /*field%3D*
Disallow /*order%3D*
Disallow /*feedbacks

googlebot

Rule Path
Disallow /*basket
Disallow /*profile
Disallow /*sort%3D*
Disallow /*pagesize%3D*
Disallow /*targetUrl%3D*
Disallow /*field%3D*
Disallow /*order%3D*
Disallow /*feedbacks

*

Rule Path
Disallow /*basket
Disallow /*profile
Disallow /*sort%3D*
Disallow /*pagesize%3D*
Disallow /*targetUrl%3D*
Disallow /*field%3D*
Disallow /*order%3D*
Disallow /*feedbacks

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /