buset.ru
robots.txt

Robots Exclusion Standard data for buset.ru

Resource Scan

Scan Details

Site Domain buset.ru
Base Domain buset.ru
Scan Status Ok
Last Scan2026-02-21T18:00:45+00:00
Next Scan 2026-02-28T18:00:45+00:00

Last Scan

Scanned2026-02-21T18:00:45+00:00
URL https://buset.ru/robots.txt
Domain IPs 2a03:6f00:1::5c35:6069, 92.53.96.105
Response IP 92.53.96.105
Found Yes
Hash c46b6aa6a8ad79a339aac217b1d437806e48aa53bb821215b5bdfb7f23439dad
SimHash df54c8d84bf3

Groups

*

Rule Path
Disallow /*html
Disallow /*page%3D*
Disallow /users/
Disallow /help/
Disallow /user/
Disallow /cabinet/
Disallow /contact/
Disallow /item/
Disallow /*sort%3D*
Disallow /*print%3D*
Disallow /*away%3D*
Disallow /*lt%3D*
Disallow /*region%3D*
Disallow /*c%3D*
Disallow /*?
Disallow /lnr/
Disallow /crimea/
Disallow /dnr/
Disallow /hnr/

yandex

Rule Path
Disallow /*c%3D*
Disallow /*html
Disallow /*page%3D*
Disallow /users/
Disallow /help/
Disallow /user/
Disallow /cabinet/
Disallow /contact/
Disallow /item/
Disallow /*sort%3D*
Disallow /*print%3D*
Disallow /*away%3D*
Disallow /*lt%3D*
Disallow /*region%3D*
Disallow /*?
Disallow /lnr/
Disallow /crimea/
Disallow /dnr/
Disallow /hnr/

yandex
ahrefsbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sistrix

Rule Path
Disallow /
Disallow /go.php

spbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://buset.ru/files/sitemap.xml

Warnings

  • `host` is not a known field.