home.1k.by
robots.txt

Robots Exclusion Standard data for home.1k.by

Resource Scan

Scan Details

Site Domain home.1k.by
Base Domain 1k.by
Scan Status Ok
Last Scan2024-11-03T07:36:49+00:00
Next Scan 2024-12-03T07:36:49+00:00

Last Scan

Scanned2024-11-03T07:36:49+00:00
URL https://home.1k.by/robots.txt
Domain IPs 93.125.53.121
Response IP 93.125.53.121
Found Yes
Hash 793a1f4b170c6ab10b67bcdc550283e84ebeeacc5bd4c7556a9c996b05db838f
SimHash c01f577a2302

Groups

googlebot

Rule Path
Disallow /admin/
Disallow /*-ajax
Disallow /*.php
Disallow /*?
Disallow /*/page1$
Disallow /user/
Disallow /*/s.php
Disallow /*/compare
Disallow /*/error/
Disallow /productsdescriptions/infoalert-
Disallow /products/
Disallow /productscategories/
Disallow /*/*/*/services/
Disallow /*/*/*/useful/
Disallow /*/*/*/beznal/
Disallow /*/all-table/page
Disallow /polls/
Disallow /usersshops/moredetails-
Disallow /*/shop-*.html
Disallow /_*/page
Disallow /*/another/
Disallow /*/choice-*/page
Disallow /*/fp-*/page

yandex

Rule Path
Disallow /*/amp/$
Disallow /admin/
Disallow /*-ajax
Disallow /*.php
Disallow /*?
Disallow /*/page1$
Disallow /user/
Disallow /*/s.php
Disallow /*/compare
Disallow /*/error/
Disallow /productsdescriptions/infoalert-
Disallow /products/
Disallow /productscategories/
Disallow /*/*/*/services/
Disallow /*/*/*/useful/
Disallow /*/*/*/beznal/
Disallow /*/all-table/page
Disallow /polls/
Disallow /usersshops/moredetails-
Disallow /*/shop-*.html
Disallow /_*/page
Disallow /*/another/
Disallow /*/choice-*/page
Disallow /*/fp-*/page

stackrambler

Rule Path
Disallow /*/amp/$
Disallow /admin/
Disallow /*-ajax
Disallow /*.php
Disallow /*?
Disallow /*/page1$
Disallow /user/
Disallow /*/s.php
Disallow /*/compare
Disallow /*/error/
Disallow /productsdescriptions/infoalert-
Disallow /products/
Disallow /productscategories/
Disallow /*/*/*/services/
Disallow /*/*/*/useful/
Disallow /*/*/*/beznal/
Disallow /*/all-table/page
Disallow /polls/
Disallow /usersshops/moredetails-
Disallow /*/shop-*.html
Disallow /_*/page
Disallow /*/another/
Disallow /*/choice-*/page
Disallow /*/fp-*/page

msnbot

Rule Path
Disallow /*/amp/$
Disallow /admin/
Disallow /*-ajax
Disallow /*.php
Disallow /*?
Disallow /*/page1$
Disallow /user/
Disallow /*/s.php
Disallow /*/compare
Disallow /*/error/
Disallow /productsdescriptions/infoalert-
Disallow /products/
Disallow /productscategories/
Disallow /*/*/*/services/
Disallow /*/*/*/useful/
Disallow /*/*/*/beznal/
Disallow /*/all-table/page
Disallow /polls/
Disallow /usersshops/moredetails-
Disallow /*/shop-*.html
Disallow /_*/page
Disallow /*/another/
Disallow /*/choice-*/page
Disallow /*/fp-*/page

mail.ru

Rule Path
Disallow /*/amp/$
Disallow /admin/
Disallow /*-ajax
Disallow /*.php
Disallow /*?
Disallow /*/page1$
Disallow /user/
Disallow /*/s.php
Disallow /*/compare
Disallow /*/error/
Disallow /productsdescriptions/infoalert-
Disallow /products/
Disallow /productscategories/
Disallow /*/*/*/services/
Disallow /*/*/*/useful/
Disallow /*/*/*/beznal/
Disallow /*/all-table/page
Disallow /polls/
Disallow /usersshops/moredetails-
Disallow /*/shop-*.html
Disallow /_*/page
Disallow /*/another/
Disallow /*/choice-*/page
Disallow /*/fp-*/page

psbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

aport

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

webalta

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

yadirectbot

Rule Path
Disallow

Warnings

  • 2 invalid lines.
  • `host` is not a known field.