baumarket.by
robots.txt
Robots Exclusion Standard data for baumarket.by
Resource Scan
Scan Details
| Site Domain | baumarket.by |
| Base Domain | baumarket.by |
| Scan Status | Ok |
| Last Scan | 2024-08-28T07:11:31+00:00 |
| Next Scan | 2024-09-27T07:11:31+00:00 |
Last Scan
| Scanned | 2024-08-28T07:11:31+00:00 |
| URL | https://baumarket.by/robots.txt |
| Domain IPs | 93.125.48.20 |
| Response IP | 93.125.48.20 |
| Found | Yes |
| Hash | 00abc55e647b4da3c95bc0c7bccea84d08fd1ae9437a024bf396de5ff6b8b036 |
| SimHash | 455c4d4337d1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.png |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.svg |
| Allow | /*?page= |
| Disallow | /*? |
| Disallow | */admin/ |
| Disallow | */backend/ |
| Disallow | */cart/ |
| Disallow | */recovery/ |
| Disallow | */istoriya-prosmotrov/ |
| Disallow | */izbrannoe/ |
| Disallow | */search/ |
| Disallow | */login/ |
| Disallow | */signup/ |
| Disallow | */opt/site/ |
| Disallow | */image/ |
| Disallow | */cookies/ |
| Disallow | */opt/opt/* |
| Disallow | *.pdf* |
googlebot
| Rule | Path |
|---|---|
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.png |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.svg |
| Allow | /*?page= |
| Disallow | /*? |
| Disallow | */admin/ |
| Disallow | */backend/ |
| Disallow | */cart/ |
| Disallow | */recovery/ |
| Disallow | */istoriya-prosmotrov/ |
| Disallow | */izbrannoe/ |
| Disallow | */search/ |
| Disallow | */login/ |
| Disallow | */signup/ |
| Disallow | */opt/site/ |
| Disallow | */image/ |
| Disallow | */cookies/ |
| Disallow | *.pdf* |
yandex
| Rule | Path |
|---|---|
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.png |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.svg |
| Allow | /*?page= |
| Disallow | /*? |
| Disallow | */admin/ |
| Disallow | */backend/ |
| Disallow | */cart/ |
| Disallow | */recovery/ |
| Disallow | */istoriya-prosmotrov/ |
| Disallow | */izbrannoe/ |
| Disallow | */search/ |
| Disallow | */login/ |
| Disallow | */signup/ |
| Disallow | */opt/site/ |
| Disallow | */image/ |
| Disallow | */cookies/ |
| Disallow | *.pdf* |
pr-cy-bot
mj12bot
claudebot
claudebot/1.0
semrushbot
ahrefsbot
bluechipbacklinks
dotbot
dotbot/1.2
mail.ru_bot
mail.ru_bot/2.0
blexbot
keys-so-bot
dataforseobot
dataforseobot/1.0
zoominfobot
barkrowler
barkrowler/0.9
amazonbot
amazonbot/0.1
nicecrawler
nicecrawler/1.1
seekportbot
imagesiftbot
wpbot/1.1
orbbot/1.1
seopultcontentanalyzer/1.0
ccbot
ccbot/2.0
surdotlybot
surdotlybot/1.0
letsearchbot
letsearchbot/1.0
serpstatbot
serpstatbot/2.1
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://baumarket.by/sitemapindex.xml |
| sitemap | https://baumarket.by/sitemapindex.xml |
| sitemap | https://baumarket.by/sitemapindex.xml |