sexshop.rozetka.com.ua
robots.txt

Robots Exclusion Standard data for sexshop.rozetka.com.ua

Resource Scan

Scan Details

Site Domain sexshop.rozetka.com.ua
Base Domain rozetka.com.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T17:30:24+00:00
Next Scan 2024-10-30T17:30:24+00:00

Last Successful Scan

Scanned2024-06-26T16:07:45+00:00
URL https://sexshop.rozetka.com.ua/robots.txt
Domain IPs 45.128.216.200
Response IP 45.128.216.200
Found Yes
Hash 982fc07beae972c2b2ce7e5cb9ce728617501a91fa3ca64a4d708a203025ff6e
SimHash d200c0ca9501

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /search/
Disallow /ua/search/
Disallow /*sort%3D*
Disallow /*utm_medium%3Drooms*
Disallow /*tab%3D*
Disallow /*gclid%3D*
Disallow /*yclid%3D*
Disallow /*delivery/
Disallow /*utm_trafmaguid%3D*
Disallow /comparison/
Disallow /*/comparison/
Disallow /landing_pages/*
Disallow /*kits_costs*
Disallow /landing-pages/*
Disallow /lazy_load/*
Disallow /*recent.rss
Allow /recent_recommends/action%3DgetGoodsDetailsJSON/?goods_ids
Disallow /*?*
Allow /*?utm_l=r*
Allow /*?advToken=*
Disallow /*%2C*
Disallow /cabinet/*
Disallow /ua/cabinet/*

yahoo

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /