Log In Sign Up

bit.su
robots.txt

Robots Exclusion Standard data for bit.su

Resource Scan

Scan Details

Site Domain bit.su
Base Domain bit.su
Scan Status Ok
Last Scan2024-10-24T06:33:44+00:00
Next Scan 2024-11-23T06:33:44+00:00

Last Scan

Scanned2024-10-24T06:33:44+00:00
URL https://bit.su/robots.txt
Domain IPs 95.163.239.167
Response IP 95.163.239.167
Found Yes
Hash 1f80bf3e598e942f21318a1c522d828a400b53a393d7d019fb1b8debd6615b7d
SimHash 429dcbe36f93

Groups

*

Rule Path
Disallow /*route%3Dcheckout/
Disallow /index.php?route=common%2Fcart%2Fmobileinfo
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /catalog
Disallow /index.php?route=product%2Fproduct&path=%3F
Disallow /download
Disallow /system
Disallow /*?search=
Disallow /search/
Disallow /search/?tag=
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*mfp
Disallow /*?mfp=
Disallow /*%26mfp%3D
Disallow /?sort=
Disallow /?limit=
Disallow /bit.bit.su
Disallow /*?mfp=
Disallow /*%26mfp%3D
Disallow /mfp?
Disallow /mfp/
Allow /catalog/view/javascript/
Allow /catalog/view/theme/*/

yandex

Rule Path
Disallow /index.php?route=product%2Fproduct&path=%3F
Disallow /index.php?route=extension%2Fpayment%2Fpsbankpayment%2Fbackref&order_id=%3F
Disallow /index.php?route=extension%2Fpayment%2Fpsbankpayment%2Fbackref&order_id=*
Disallow /index.php?route=extension%2Fpayment%2Fpsbankpayment%2Fbackref&order_id=
Disallow /novye-postupleniya/
Disallow /*?route=extension%2Fpayment%2Fpsbankpayment%2F
Disallow /*?route=extension%2Fpayment%2Fpsbankpayment%2Fbackref&order_id=%3F
Disallow /*?route=extension%2Fpayment%2Fpsbankpayment%2Fbackref&order_id=*
Disallow /*?route=extension%2Fpayment%2Fpsbankpayment%2Fbackref&order_id=
Disallow /*novye-postupleniya/
Disallow /index.php?route=product%2Fproduct&path=*
Disallow /index.php?route=account%2Freset&code=%3F
Disallow /index.php?route=account%2Freset&code=*
Disallow /index.php?route=account%2Freset&code=
Disallow /index.php?route=account%2F
Disallow /*route%3Dcheckout/
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /index.php?route=product%2Fproduct&path=
Disallow /catalog
Disallow /download
Disallow /system
Disallow /*?search=
Disallow /search/
Disallow /search/?tag=
Disallow /?tag=
Disallow /*tag%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?mfp=
Disallow /*%26mfp%3D
Disallow /?mfp=
Disallow /*?limit=
Disallow /*limit%3D
Disallow /*?limit=
Disallow /?sort=
Disallow /?limit=
Disallow /*?mfp=
Disallow /*%26mfp%3D
Disallow /mfp?
Disallow /mfp/
Disallow /*mfp
Disallow /mfp/?
Allow /catalog/view/javascript/
Allow /catalog/view/theme/*/

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://bit.su/index.php?route=extension/feed/google_sitemap
sitemap https://bit.su/index.php?route=extension/feed/yandex_sitemap
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top