mfsibir.ru
robots.txt

Robots Exclusion Standard data for mfsibir.ru

Resource Scan

Scan Details

Site Domain mfsibir.ru
Base Domain mfsibir.ru
Scan Status Ok
Last Scan2024-11-18T07:24:06+00:00
Next Scan 2024-12-18T07:24:06+00:00

Last Scan

Scanned2024-11-18T07:24:06+00:00
URL https://mfsibir.ru/robots.txt
Domain IPs 188.225.58.146
Response IP 188.225.58.146
Found Yes
Hash 7dfb86795f96b151f09971bca4a427c296d647a4b6e46203bfa3b39bdddc280b
SimHash 6779cbf3e7d3

Groups

*

Rule Path
Disallow /*?
Allow /bitrix/components/
Allow /bitrix/cache/
Allow /bitrix/js/
Allow /bitrix/templates/
Disallow /bitrix/panel/
Allow /local/components/
Allow /local/cache/
Allow /local/js/
Allow /local/templates/
Disallow /bitrix/
Disallow /auth/
Disallow /cart/
Disallow /personal/
Disallow /shoppingcart/
Disallow /*_or_
Disallow /*utm_
Disallow /*.js
Disallow /*.css
Disallow /*.php
Disallow /*.html
Disallow /*.pdf
Disallow /*.doc
Disallow /*filter%3D
Disallow /*filter/
Allow /*filter/factura
Allow /*filter/tolshchina
Allow /*filter/color
Disallow /*filter/factura*/tolshchina*
Disallow /*filter/color*/tolshchina*
Disallow /*manufacturer*
Disallow */filter/tolshchina-is-*-or-*/
Disallow */filter/factura-is-*-or-*/
Disallow */filter/color-is-*-or-*/

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mfsibir.ru/sitemap.xml
sitemap https://mfsibir.ru/sitemap_filter.xml

Warnings

  • `host` is not a known field.