smotr.ru
robots.txt

Robots Exclusion Standard data for smotr.ru

Resource Scan

Scan Details

Site Domain smotr.ru
Base Domain smotr.ru
Scan Status Ok
Last Scan2026-01-30T07:16:17+00:00
Next Scan 2026-03-01T07:16:17+00:00

Last Scan

Scanned2026-01-30T07:16:17+00:00
URL https://smotr.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:268, 31.31.197.5
Response IP 31.31.197.5
Found Yes
Hash 08e95c527de5e690f63c2d52aef7f8c13a26caaa5271f2eb33bea8ab1f5b5b99
SimHash 6a49d9931115

Groups

yandex

Rule Path
Disallow

googlebot

Rule Path
Disallow

stackrambler

Rule Path
Disallow

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /

msnbot-media
googlebot-image
yahoo-mmcrawler

Rule Path
Disallow /