5urokov.ru
robots.txt

Robots Exclusion Standard data for 5urokov.ru

Resource Scan

Scan Details

Site Domain 5urokov.ru
Base Domain 5urokov.ru
Scan Status Ok
Last Scan2024-10-02T10:12:21+00:00
Next Scan 2024-10-09T10:12:21+00:00

Last Scan

Scanned2024-10-02T10:12:21+00:00
URL https://5urokov.ru/robots.txt
Domain IPs 104.21.35.105, 172.67.217.186, 2606:4700:3031::6815:2369, 2606:4700:3037::ac43:d9ba
Response IP 172.67.217.186
Found Yes
Hash 543dfaf9b4366bcacd70efd83f5114210a13e289c7f663839faf48428edc46a8
SimHash c11825056f91

Groups

*

Rule Path
Allow /*?ref=
Allow /publ/rssya_zen
Disallow /*?page*%3F
Disallow /?
Disallow /a/
Disallow /*?
Disallow /stat/
Disallow /register
Disallow /index/1
Disallow /index/2
Disallow /index/3
Disallow /index/5
Disallow /index/7
Disallow /index/8
Disallow /index/9
Disallow /index/11
Disallow /index/14
Disallow /index/0-12
Disallow /index/0-24
Disallow /index/0-25
Disallow /index/sub/
Disallow /panel/
Disallow /admin/
Disallow /informer/
Disallow /secure/
Disallow /poll/
Disallow /search/
Disallow /abnl/
Disallow /*_escaped_fragment_%3D
Disallow /*-*-*-*-987$
Disallow /shop/checkout/
Disallow /shop/user/
Disallow /*0-*-0-17$
Disallow /*0-0-

Other Records

Field Value
sitemap https://5urokov.su/sitemap.xml

Warnings

  • `host` is not a known field.