hunter.rozetka.com.ua
robots.txt

Robots Exclusion Standard data for hunter.rozetka.com.ua

Resource Scan

Scan Details

Site Domain hunter.rozetka.com.ua
Base Domain rozetka.com.ua
Scan Status Ok
Last Scan2024-10-04T10:45:18+00:00
Next Scan 2024-10-18T10:45:18+00:00

Last Scan

Scanned2024-10-04T10:45:18+00:00
URL https://hunter.rozetka.com.ua/robots.txt
Domain IPs 45.128.216.200
Response IP 45.128.216.200
Found Yes
Hash 7265a3e7299245ee059cf1bd54993e9386819465cadb0898b1af0e0a5effd751
SimHash f200c0ca8509

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /search/
Disallow /ua/search/
Disallow /*sort%3D*
Disallow /*utm_medium%3Drooms*
Disallow /*tab%3D*
Disallow /*gclid%3D*
Disallow /*yclid%3D*
Disallow /*delivery/
Disallow /*utm_trafmaguid%3D*
Disallow /comparison/
Disallow /*/comparison/
Disallow /landing_pages/*
Disallow /*kits_costs*
Disallow /landing-pages/*
Disallow /lazy_load/*
Disallow /*recent.rss
Allow /recent_recommends/action%3DgetGoodsDetailsJSON/?goods_ids
Disallow /*?*
Allow /*?utm_l=r*
Allow /*?advToken=*
Disallow /*%2C*
Disallow /cabinet/*
Disallow /ua/cabinet/*

yahoo

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /