ru.aboutyou.ee
robots.txt

Robots Exclusion Standard data for ru.aboutyou.ee

Resource Scan

Scan Details

Site Domain ru.aboutyou.ee
Base Domain aboutyou.ee
Scan Status Ok
Last Scan2026-02-03T11:36:51+00:00
Next Scan 2026-02-10T11:36:51+00:00

Last Scan

Scanned2026-02-03T11:36:51+00:00
URL https://ru.aboutyou.ee/robots.txt
Domain IPs 104.18.0.101, 104.18.1.101, 2606:4700::6812:165, 2606:4700::6812:65
Response IP 104.18.0.101
Found Yes
Hash 4e89a35c8353ee60f6b295bb79594cc10d2c215d44e96b90834d02747ebe4217
SimHash 4b30533afd81

Groups

*

Rule Path
Allow *
Disallow /a/
Disallow /checkout
Disallow /cs
Disallow /cw
Disallow /redirect-link
Disallow /redirect-url
Disallow /search
Disallow /*/similar
Disallow /hub/streetwear
Disallow /*?*price_max=
Disallow /*?*maxPrice=
Disallow /*?*price_min=
Disallow /*?*minPrice=
Disallow /*?*quantityPerPack=
Disallow /*?*sale=
Disallow /*?*quickSale=
Disallow /*?*genderage=
Disallow /*?*filter=
Disallow /*?*isNew=
Disallow /*?*isNewQuick=
Disallow /*?*styleGroup=
Disallow /*?*showFilterMenu=
Disallow /*?*discount=
Disallow /*?*prices=
Disallow /*?*hasCampaignReduction=
Disallow /*?*sort=
Disallow /*?*firstProductId=
Allow /p/*?*firstProductId=
Disallow /*?*cpn=
Allow /p/*?*cpn=
Disallow /*?*mobileSite=
Allow /__/legacy_state?mobileSite=1&url=%2Fs%2F
Allow /__/legacy_state?mobileSite=1&url=%2Fo%2F
Allow /__/legacy_state?mobileSite=1&url=%2Ft%2F
Allow /__/legacy_state?mobileSite=1&url=%2Fh%2F
Allow /__/legacy_state?mobileSite=1&url=%2Fh$
Allow /__/legacy_state?mobileSite=1&url=%2Fh%3F
Allow /*?*page=1&
Allow /*?*page=2&
Allow /*?*page=3&
Allow /*?*page=1$
Allow /*?*page=2$
Allow /*?*page=3$
Disallow /*?*page=
Disallow /api/health
Disallow /__/logs
Disallow /__/legacy_state?url=%2Fp%2F
Disallow /__/legacy_state?url=%2Fc%2F
Disallow /__/legacy_state?url=%2Fb%2F
Disallow /b/discover/
Disallow /apple-touch-icon.png

adsbot-google

Rule Path
Disallow /__/logs

ahrefsbot
semrushbot
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ru.aboutyou.ee/sitemap/ruee/sitemap-index.xml

Comments

  • block login-pages
  • block app-pages
  • block search
  • block similar-pages
  • block streetware hub
  • block individual filter parameters (will never be used)
  • block individual parameters
  • limit pagination
  • block API
  • block discover
  • block incorrect favicon
  • sitemaps
  • block API
  • block crawler