Log In Sign Up

rybray.com.ua
robots.txt

Robots Exclusion Standard data for rybray.com.ua

Resource Scan

Scan Details

Site Domain rybray.com.ua
Base Domain rybray.com.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-26T12:10:52+00:00
Next Scan 2026-04-26T12:10:52+00:00

Last Successful Scan

Scanned2025-09-04T16:57:18+00:00
URL https://rybray.com.ua/robots.txt
Domain IPs 104.21.65.245, 172.67.195.204, 2606:4700:3033::ac43:c3cc, 2606:4700:3035::6815:41f5
Response IP 104.21.65.245
Found Yes
Hash 046131344eafc7acd3fc3695802d4a6224e4c6a22a79db3d4644981e93bef43f
SimHash 281e1111a502

Groups

*

Rule Path
Disallow */customer/*
Disallow */sales/order/history/
Disallow */wishlist/
Disallow */mobilelogin/otp/update/
Disallow */advencedcompare/*
Disallow *sort*

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

applebot

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

meta-externalagent

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /
Disallow /catalogsearch/
Disallow /*?*
Disallow /*%26*
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /*.png$
Allow /*.svg$
Allow /*.webp$
Back to top

Other Records

Field Value
sitemap https://rybray.com.ua/sitemap-uk.xml
sitemap https://rybray.com.ua/sitemap-ru.xml
Back to top

Comments

  • SEO та основні пошуковики
  • AI-боти: дозволяємо (бо є Rate Limit у Cloudflare)
  • Небажані/шкідливі боти
  • Пошук і фільтри
Back to top