metallprofil.uz
robots.txt

Robots Exclusion Standard data for metallprofil.uz

Resource Scan

Scan Details

Site Domain metallprofil.uz
Base Domain metallprofil.uz
Scan Status Ok
Last Scan2026-01-28T02:36:49+00:00
Next Scan 2026-02-27T02:36:49+00:00

Last Scan

Scanned2026-01-28T02:36:49+00:00
URL https://metallprofil.uz/robots.txt
Domain IPs 178.248.235.246
Response IP 178.248.235.246
Found Yes
Hash fff5295dad0bf13802fdb40837425bc8c39af8d138f4b25acaea99c8d305c97c
SimHash c49479528fa5

Groups

*

Rule Path
Disallow /*%26
Disallow /*%3D
Allow /*?v=
Allow /local/ajax/*%3D
Disallow */?
Disallow /*?ELEMENT_ID=
Allow /*?PAGEN_1
Allow */?utm_source=
Disallow *%40
Disallow *%40*?PAGEN_
Disallow /*?PAGEN*&
Disallow /*TAB%3D?PAGEN
Disallow /*backurl*?PAGEN
Disallow */allinmap.php
Disallow *tel%3A
Disallow /bitrix/
Allow /bitrix/*.css
Allow /bitrix/*.js
Allow /bitrix/*.xml
Allow /fonts/*.ttf
Allow /fonts/*.woff
Disallow */contacts-new/
Disallow /upload/
Allow /upload*iblock/*.pdf$
Allow /upload*iblock/*.jpg$
Allow /upload*iblock/*.png$
Allow /upload*iblock/*.svg$
Allow /upload*iblock/*.gif$
Allow /upload*iblock/*.webp$
Allow /upload/images/
Allow /upload/menu_files/
Disallow /guarantee/
Disallow /examples/my-components/
Disallow /examples/download/download_private/
Disallow */auth/
Disallow */auth.php$
Disallow /*personal/
Disallow */search/
Disallow */slide_show/
Disallow */index.php$
Disallow */about/documents/soup.php
Disallow /*catalogFilter_*
Disallow */order/
Disallow */filter/
Disallow */filter/*/apply/*
Disallow */filter/*?PAGEN
Disallow */compare.php
Disallow /vybrat_dom/?result_test*
Disallow /shop/registration/
Disallow /shop/informatsiya/press-tsentr/stati/
Disallow /shop/informatsiya/press-tsentr/videomaterialy/
Disallow /coating/filter/clear/
Disallow /coating/compare/
Disallow */black-friday
Disallow */stalnaya-pyatnitsa
Disallow /shop/utilities/_test_pbd.php
Disallow /shop/pokupatelyam/depth/0_4_MC/
Disallow /shop/informatsiya/natsenka/
Disallow /postavshchikam-uslug*
Disallow /calculators/siding-iframe*
Disallow */sberbank-online/
Disallow */catalog/*/offer/

smtbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

camontspider

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

discobot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

linguee

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

grapeshot

Rule Path
Disallow /

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /

riddler (http://riddler.io/about)

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

yandexadditional

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgenie

Rule Path
Disallow /

jasper.ai

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://metallprofil.uz/sitemap.xml

Comments

  • ver. 24.04.2025

Warnings

  • 4 invalid lines.
  • `clean-param` is not a known field.