bestsex-shop.ru
robots.txt

Robots Exclusion Standard data for bestsex-shop.ru

Resource Scan

Scan Details

Site Domain bestsex-shop.ru
Base Domain bestsex-shop.ru
Scan Status Ok
Last Scan2025-05-30T05:12:25+00:00
Next Scan 2025-06-13T05:12:25+00:00

Last Scan

Scanned2025-05-30T05:12:25+00:00
URL https://bestsex-shop.ru/robots.txt
Domain IPs 37.46.135.18
Response IP 37.46.135.18
Found Yes
Hash fbe729d6bb771fd043a9ebeb4b22d616bf3f794c86a20239b0e5b9edd837456e
SimHash 498816637fa8

Groups

*

Rule Path
Disallow /my/
Disallow /checkout/
Disallow /search/?query=
Disallow /search/?page=
Disallow /search/*
Disallow /blog/
Disallow /compare/
Disallow /tag/
Disallow *%26sort%3D
Disallow */?sort=
Disallow /cart/
Disallow /checkout/
Disallow /my/
Disallow /signup/
Disallow /login/
Disallow /forgotpassword/
Disallow /webasyst/
Disallow /cartsheartbeat/*
Disallow /productsetsBuy/*
Disallow /*?price_
Disallow /*%26price_
Disallow /?unit
Disallow /?*unit
Disallow /*?diametr
Disallow /*%26diametr
Disallow /*?length
Disallow /*%26length
Disallow /*?razmer
Disallow /*%26razmer
Disallow /*?convead_
Disallow /*from%3D
Disallow /*utm_*
Disallow /*nomobile%3D
Disallow /?mail
Disallow *?brend%5B%5D=
Disallow /photos/
Disallow /*list%3D
Disallow /*?sku=
Disallow /market/
Disallow /prezervativy/po-brendam/$
Disallow /prezervativy/po-brendam/?page=
Disallow /ufa/

yandex

Rule Path
Disallow /search/?query=
Disallow /search/?page=
Disallow /search/*
Disallow /blog/
Disallow /compare/
Disallow /tag/
Disallow *%26sort%3D
Disallow */?sort=
Disallow /cart/
Disallow /checkout/
Disallow /checkout/*
Disallow /my/
Disallow /signup/
Disallow /login/
Disallow /forgotpassword/
Disallow /webasyst/
Disallow /cartsheartbeat/*
Disallow /productsetsBuy/*
Disallow /*?price_
Disallow /*%26price_
Disallow /?unit
Disallow /?*unit
Disallow /*?diametr
Disallow /*%26diametr
Disallow /*?length
Disallow /*%26length
Disallow /*?razmer
Disallow /*%26razmer
Disallow /*?convead_
Disallow /*from%3D
Disallow /*utm_*
Disallow /*nomobile%3D
Disallow /?mail
Disallow *?brend%5B%5D=
Disallow /photos/
Disallow /*list%3D
Disallow /*?sku=
Disallow /market/
Disallow /prezervativy/po-brendam/$
Disallow /prezervativy/po-brendam/?page=
Disallow /ufa/

ahrefsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

megaindex.ru/.com/megaindex

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sbarkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

yak

Rule Path
Disallow /

niraiya.com

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

cloudfind

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

seopultcontentanalyzer

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

flipboardrss

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bestsex-shop.ru/sitemap.xml

Comments

  • wa shop
  • wa shop

Warnings

  • `host` is not a known field.