specstali.by
robots.txt

Robots Exclusion Standard data for specstali.by

Resource Scan

Scan Details

Site Domain specstali.by
Base Domain specstali.by
Scan Status Ok
Last Scan2025-10-07T23:21:27+00:00
Next Scan 2025-11-06T23:21:27+00:00

Last Scan

Scanned2025-10-07T23:21:27+00:00
URL https://specstali.by/robots.txt
Domain IPs 5.181.252.15
Response IP 5.181.252.15
Found Yes
Hash d955582b8648fd8d661b2960c957bead32e46ca17cef9c2f30da1277ce6720de
SimHash 4f8ec4ebc321

Groups

yandex

Rule Path
Disallow /?
Disallow *%2F
Disallow /search/
Disallow /cart/
Disallow /cart
Disallow /ordercomlite
Disallow /ordercomlite/
Disallow /onlineprice
Disallow /onlineprice/
Disallow /onlineorder
Disallow /onlineorder/
Disallow /online_get_price
Disallow /online_get_price/
Disallow /bay/
Disallow /admin/
Disallow /*.pdf
Disallow /*.xls
Disallow /*.doc
Disallow /specstal/*
Disallow /*.ppt
Disallow /?_ga*
Disallow /podshipniki/
Disallow /*block%3D
Disallow /*pos%3D
Disallow /*openstat%3D
Disallow /*yclid%3D
Disallow /*gclid%3D
Disallow /*utm_campaign%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*adv%3D
Disallow /*pc%3D
Disallow /*preview%3D
Disallow /search/results/?search=
Allow /static/css*.css
Allow /static/js*.js
Allow /media/uploads/images*.jpg
Allow /media/uploads/images*.jpeg
Allow /media/uploads/images*.png
Allow /media/uploads/images*.gif

googlebot

Rule Path
Disallow /?
Disallow /search/
Disallow /specstal/*
Disallow /cart/
Disallow /cart
Disallow /ordercomlite
Disallow /ordercomlite/
Disallow /onlineprice
Disallow /onlineprice/
Disallow /onlineorder
Disallow /onlineorder/
Disallow /online_get_price
Disallow /online_get_price/
Disallow /bay/
Disallow /admin/
Disallow /*.pdf
Disallow /*.xls
Disallow /*.doc
Disallow /*.ppt
Disallow /?_ga*
Disallow /podshipniki/
Disallow /*block%3D
Disallow /*pos%3D
Disallow /*openstat%3D
Disallow /*yclid%3D
Disallow /*gclid%3D
Disallow /*utm_campaign%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*adv%3D
Disallow /*pc%3D
Disallow /*preview%3D
Disallow /search/results/?search=
Allow /static/css*.css
Allow /static/js*.js
Allow /media/uploads/images*.jpg
Allow /media/uploads/images*.jpeg
Allow /media/uploads/images*.png
Allow /media/uploads/images*.gif

bingbot

Rule Path
Disallow /search/results/?search=

Other Records

Field Value
crawl-delay 29

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /?
Disallow *%2F
Disallow /search/
Disallow /cart/
Disallow /cart
Disallow /ordercomlite
Disallow /ordercomlite/
Disallow /onlineprice
Disallow /onlineprice/
Disallow /specstal/*
Disallow /onlineorder
Disallow /onlineorder/
Disallow /online_get_price
Disallow /online_get_price/
Disallow /bay/
Disallow /admin/
Disallow /*utm
Disallow /*clid%3D
Disallow /*openstat
Disallow /*from
Disallow /*.pdf
Disallow /*.xls
Disallow /*.doc
Disallow /*.ppt
Disallow /?_ga*
Disallow /podshipniki/
Disallow /*block%3D
Disallow /*pos%3D
Disallow /*openstat%3D
Disallow /*yclid%3D
Disallow /*gclid%3D
Disallow /*utm_campaign%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*adv%3D
Disallow /*pc%3D
Disallow /*preview%3D
Disallow /search/results/?search=
Allow /static/css*.css
Allow /static/js*.js
Allow /media/uploads/images*.jpg
Allow /media/uploads/images*.jpeg
Allow /media/uploads/images*.png
Allow /media/uploads/images*.gif

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

ia_archiver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ltx71

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

serpstatbot/1.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://specstali.by/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.