specmet.uz
robots.txt

Robots Exclusion Standard data for specmet.uz

Resource Scan

Scan Details

Site Domain specmet.uz
Base Domain specmet.uz
Scan Status Ok
Last Scan2025-09-15T00:03:17+00:00
Next Scan 2025-10-15T00:03:17+00:00

Last Scan

Scanned2025-09-15T00:03:17+00:00
URL https://specmet.uz/robots.txt
Domain IPs 109.248.32.26
Response IP 109.248.32.26
Found Yes
Hash c6ba95e63b433637edcd4c705fefcc4def81c3c51b203f6c0f13fac5882c863b
SimHash 4a8ec46bc321

Groups

yandex

Rule Path
Disallow *%2F
Disallow /search/
Disallow /specstal/*
Disallow /cart/
Disallow /cart
Disallow /ordercomlite
Disallow /ordercomlite/
Disallow /onlineprice
Disallow /onlineprice/
Disallow /onlineorder
Disallow /onlineorder/
Disallow /online_get_price
Disallow /online_get_price/
Disallow /bay/
Disallow /admin/
Disallow /*.pdf
Disallow /*.xls
Disallow /*.doc
Disallow /*.ppt
Disallow /?_ga*
Disallow /podshipniki/
Disallow /*block%3D
Disallow /*pos%3D
Disallow /*openstat%3D
Disallow /*yclid%3D
Disallow /*gclid%3D
Disallow /*utm_campaign%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*adv%3D
Disallow /*pc%3D
Disallow /*preview%3D
Disallow /search/results/?search=
Allow /static/css*.css
Allow /static/js*.js
Allow /media/uploads/images*.jpg
Allow /media/uploads/images*.jpeg
Allow /media/uploads/images*.png
Allow /media/uploads/images*.gif

googlebot

Rule Path
Disallow /?
Disallow /specstal/*
Disallow /search/
Disallow /cart/
Disallow /cart
Disallow /ordercomlite
Disallow /ordercomlite/
Disallow /onlineprice
Disallow /onlineprice/
Disallow /onlineorder
Disallow /onlineorder/
Disallow /online_get_price
Disallow /online_get_price/
Disallow /bay/
Disallow /admin/
Disallow /*.pdf
Disallow /*.xls
Disallow /*.doc
Disallow /*.ppt
Disallow /?_ga*
Disallow /podshipniki/
Disallow /*block%3D
Disallow /*pos%3D
Disallow /*openstat%3D
Disallow /*yclid%3D
Disallow /*gclid%3D
Disallow /*utm_campaign%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*adv%3D
Disallow /*pc%3D
Disallow /*preview%3D
Disallow /search/results/?search=
Allow /static/css*.css
Allow /static/js*.js
Allow /media/uploads/images*.jpg
Allow /media/uploads/images*.jpeg
Allow /media/uploads/images*.png
Allow /media/uploads/images*.gif

bingbot

Rule Path
Disallow /search/results/?search=

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /specstal/*
Disallow *%2F
Disallow /?
Disallow /search/
Disallow /cart/
Disallow /cart
Disallow /ordercomlite
Disallow /ordercomlite/
Disallow /onlineprice
Disallow /onlineprice/
Disallow /onlineorder
Disallow /onlineorder/
Disallow /online_get_price
Disallow /online_get_price/
Disallow /bay/
Disallow /admin/
Disallow /*utm
Disallow /*clid%3D
Disallow /*openstat
Disallow /*from
Disallow /*.pdf
Disallow /*.xls
Disallow /*.doc
Disallow /*.ppt
Disallow /?_ga*
Disallow /podshipniki/
Disallow /*block%3D
Disallow /*pos%3D
Disallow /*openstat%3D
Disallow /*yclid%3D
Disallow /*gclid%3D
Disallow /*utm_campaign%3D
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*adv%3D
Disallow /*pc%3D
Disallow /*preview%3D
Disallow /search/results/?search=
Allow /static/css*.css
Allow /static/js*.js
Allow /media/uploads/images*.jpg
Allow /media/uploads/images*.jpeg
Allow /media/uploads/images*.png
Allow /media/uploads/images*.gif

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

ia_archiver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ltx71

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

serpstatbot/1.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://specmet.uz/sitemap.xml

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.
  • `host` is not a known field.