Log In Sign Up

agrosemena.by
robots.txt

Robots Exclusion Standard data for agrosemena.by

Resource Scan

Scan Details

Site Domain agrosemena.by
Base Domain agrosemena.by
Scan Status Ok
Last Scan2026-02-10T19:05:59+00:00
Next Scan 2026-03-12T19:05:59+00:00

Last Scan

Scanned2026-02-10T19:05:59+00:00
URL https://agrosemena.by/robots.txt
Domain IPs 178.172.217.60
Response IP 178.172.217.60
Found Yes
Hash d98a9c6087768a8814888e3f35793766f87ce6882053288e42e7cdf41ab74b71
SimHash 0e0f9e65ad33

Groups

keys-so-bot

Rule Path
Disallow /

*

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /*route%3Dproduct/product*%26manufacturer_id%3D
Disallow /*route%3Dproduct/manufacturer/info%26manufacturer_id%3D
Disallow /*route%3Dproduct/uni_latest
Disallow /*route%3Dproduct/uni_featured
Disallow /admin
Disallow /catalog
Disallow /system
Disallow /success
Disallow /semena-besplatno
Disallow /special
Disallow /*special%26page%3D
Allow /*?page
Disallow /*?
Disallow /*?term=
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Allow /*route%3Dinformation/uni_news*
Allow /*route%3Dinformation/uni_news_story*
Disallow /*%26product_id%3D
Disallow /*compare-products
Disallow /*search
Disallow /*cart
Disallow /*checkout
Disallow /*login
Disallow /*logout
Disallow /*vouchers
Disallow /*wishlist
Disallow /*my-account
Disallow /*order-history
Disallow /*newsletter
Disallow /*return-add
Disallow /*forgot-password
Disallow /*downloads
Disallow /*returns
Disallow /*transactions
Disallow /*create-account
Disallow /*recurring
Disallow /*address-book
Disallow /*reward-points
Disallow /*affiliate-forgot-password
Disallow /*create-affiliate-account
Disallow /*affiliate-login
Disallow /*affiliates
Allow /catalog/view/javascript/
Allow /catalog/view/theme/*/
Disallow /*black_list*
Disallow /black_list*

yandex

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /*route%3Dproduct/product*%26manufacturer_id%3D
Disallow /*route%3Dproduct/manufacturer/info%26manufacturer_id%3D
Disallow /admin
Disallow /catalog
Disallow /success
Disallow /system
Disallow /semena-besplatno
Disallow /special
Disallow /*special%26page%3D
Allow /*?page
Disallow /*?
Disallow /*?term=
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Allow /*route%3Dinformation/uni_news*
Allow /*route%3Dinformation/uni_news_story*
Disallow /*%26product_id%3D
Disallow /*compare-products
Disallow /*search
Disallow /*cart
Disallow /*checkout
Disallow /*login
Disallow /*logout
Disallow /*vouchers
Disallow /*wishlist
Disallow /*my-account
Disallow /*order-history
Disallow /*newsletter
Disallow /*return-add
Disallow /*forgot-password
Disallow /*downloads
Disallow /*returns
Disallow /*transactions
Disallow /*create-account
Disallow /*recurring
Disallow /*address-book
Disallow /*reward-points
Disallow /*affiliate-forgot-password
Disallow /*create-affiliate-account
Disallow /*affiliate-login
Disallow /*affiliates
Back to top

Other Records

Field Value
sitemap https://agrosemena.by/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top