masterdom.by
robots.txt
Robots Exclusion Standard data for masterdom.by
Resource Scan
Scan Details
| Site Domain | masterdom.by |
| Base Domain | masterdom.by |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-06-07T04:01:21+00:00 |
| Next Scan | 2025-07-07T04:01:21+00:00 |
Last Successful Scan
| Scanned | 2025-04-16T03:59:47+00:00 |
| URL | https://masterdom.by/robots.txt |
| Domain IPs | 185.251.38.185 |
| Response IP | 185.251.38.185 |
| Found | Yes |
| Hash | ca61c9d4cd03726ff256141c3c68f927fd852ee463638284de70e9c69e84cac8 |
| SimHash | 132f43578613 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *bxrand* |
| Disallow | *ajax* |
| Disallow | *apply* |
| Disallow | /basket* |
| Disallow | *undefinedajax* |
| Disallow | /search/ |
| Disallow | *index.php* |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /bitrix/admin/ |
| Disallow | /*clear_cache%3D |
| Disallow | /*clear_cache_session%3D |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*register%3D |
| Disallow | /*password* |
| Disallow | /*login%3D |
| Disallow | /*type%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*backurl%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /cgi-bin |
| Disallow | /bitrix/ |
| Disallow | *bitrix_*%3D |
| Disallow | /local/ |
| Disallow | /*index.php$ |
| Disallow | /auth/ |
| Disallow | *auth%3D |
| Disallow | /personal/ |
| Disallow | *register%3D |
| Disallow | *forgot_password%3D |
| Disallow | *change_password%3D |
| Disallow | *login%3D |
| Disallow | *logout%3D |
| Disallow | */search/ |
| Disallow | *ORDER_ID* |
| Disallow | *sharebasket* |
| Allow | */upload/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /local/*.js |
| Allow | /local/*.css |
| Allow | /local/*.jpg |
| Allow | /local/*.jpeg |
| Allow | /local/*.png |
| Allow | /local/*.gif |
| Allow | /images/ |
| Allow | /js/ |
| Allow | *images* |
yandex
| Rule | Path |
|---|---|
| Disallow | *bxrand* |
| Disallow | *ajax* |
| Disallow | *apply* |
| Disallow | *undefinedajax* |
| Disallow | /basket* |
| Disallow | /search/ |
| Disallow | *index.php* |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /bitrix/admin/ |
| Disallow | /*clear_cache%3D |
| Disallow | /*clear_cache_session%3D |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*register%3D |
| Disallow | /*password* |
| Disallow | /*login%3D |
| Disallow | *sort%3D* |
| Disallow | /*type%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*backurl%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /cgi-bin |
| Disallow | /bitrix/ |
| Disallow | *bitrix_*%3D |
| Disallow | /local/ |
| Disallow | /*index.php$ |
| Disallow | /auth/ |
| Disallow | *auth%3D |
| Disallow | /personal/ |
| Disallow | *register%3D |
| Disallow | *forgot_password%3D |
| Disallow | *change_password%3D |
| Disallow | *login%3D |
| Disallow | *logout%3D |
| Disallow | */search/ |
| Disallow | *ORDER_ID* |
| Disallow | *sharebasket* |
| Allow | */upload/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /local/*.js |
| Allow | /local/*.css |
| Allow | /local/*.jpg |
| Allow | /local/*.jpeg |
| Allow | /local/*.png |
| Allow | /local/*.gif |
| Allow | /images/ |
| Allow | /js/ |
| Allow | *images* |
ahrefsbot
imagesiftbot
semrushbot
dotbot
mj12bot
blexbot
mauibot
seokicks
megaindex
serpstatbot
sistrixbot
seoscanners
dataforseobot
netestate ne crawler
petalbot
aspiegelbot
veoozbot
barkrowler
seomoz
majestic-seo
linkpadbot
exabot
wbsearchbot
woorank
uptimerobot
httrack
ezooms
boardreader
brandwatch
proximic
xovibot
baiduspider
bubing
ccbot
cliqzbot
openlinkprofiler
censysinspect
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://masterdom.by/sitemap-cat.xml |
| sitemap | https://masterdom.by/sitemap-razdel.xml |
| sitemap | https://masterdom.by/sitemap-1.xml |
| sitemap | https://masterdom.by/sitemap-regions.xml |
| sitemap | https://masterdom.by/sitemap-bregion.xml |
| sitemap | https://masterdom.by/sitemap-stati.xml.gz |
| sitemap | https://masterdom.by/sitemap-other.xml.gz |
| sitemap | https://masterdom.by/sitemap-cat.xml |
| sitemap | https://masterdom.by/sitemap-razdel.xml |
| sitemap | https://masterdom.by/sitemap-1.xml |
| sitemap | https://masterdom.by/sitemap-regions.xml |
| sitemap | https://masterdom.by/sitemap-bregion.xml |
| sitemap | https://masterdom.by/sitemap-stati.xml.gz |
| sitemap | https://masterdom.by/sitemap-other.xml.gz |
Warnings
- `clean-param` is not a known field.