bosova.ru
robots.txt

Robots Exclusion Standard data for bosova.ru

Resource Scan

Scan Details

Site Domain bosova.ru
Base Domain bosova.ru
Scan Status Ok
Last Scan2026-01-31T08:19:06+00:00
Next Scan 2026-03-02T08:19:06+00:00

Last Scan

Scanned2026-01-31T08:19:06+00:00
URL https://bosova.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:7:ce00, 2a00:15f8:a000:5:1:12:7:ce00, 2a00:15f8:a000:5:1:13:7:ce00, 2a00:15f8:a000:5:1:14:7:ce00, 90.156.201.111, 90.156.201.19, 90.156.201.39, 90.156.201.42
Response IP 90.156.201.42
Found Yes
Hash 67c0e3b7618ee77b45830da9aa0cb5462c1b53179afb5459af463e5d9b17273a
SimHash 67148c658193

Groups

*

Rule Path Comment
Disallow /search/ -
Disallow /search.php -
Disallow /video/search/ -
Disallow /auth/ -
Disallow /personal/ -
Disallow /metodist/communication/forum/user/ -
Disallow /metodist/communication/forum/users/ -
Disallow /metodist/communication/forum/rss/ -
Disallow /authors/220/ Авторы без книг
Disallow /news/*rss*/ -
Disallow /news/index.php? -
Disallow /news? -
Disallow /metodist/content/photo/ -
Disallow /books/filter.php -
Disallow /*sphrase_id -
Disallow /index.php? -

Other Records

Field Value
crawl-delay 10

yandex

Rule Path Comment
Disallow /search/ -
Disallow /search.php -
Disallow /video/search/ -
Disallow /auth/ -
Disallow /personal/ -
Disallow /metodist/communication/forum/user/ -
Disallow /metodist/communication/forum/users/ -
Disallow /metodist/communication/forum/rss/ -
Disallow /authors/220/ Авторы без книг
Disallow /news/*rss*/ -
Disallow /news/index.php? -
Disallow /news? -
Disallow /metodist/content/photo/ -
Disallow /books/filter.php -
Disallow /*sphrase_id -
Disallow /index.php? -

Other Records

Field Value
crawl-delay 10

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.