sc-os.ru
robots.txt

Robots Exclusion Standard data for sc-os.ru

Resource Scan

Scan Details

Site Domain sc-os.ru
Base Domain sc-os.ru
Scan Status Ok
Last Scan2025-08-23T10:19:24+00:00
Next Scan 2025-08-30T10:19:24+00:00

Last Scan

Scanned2025-08-23T10:19:24+00:00
URL https://sc-os.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:4:0:117, 37.140.192.138
Response IP 37.140.192.138
Found Yes
Hash 181dc5c2974092271746253d505616046fd3675fe3889143515defbe0dbb80f9
SimHash 6d1ddc718611

Groups

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dlastnews
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*action%3Dmobile
Disallow /2016/
Disallow /page/

Other Records

Field Value
sitemap https://sc-os.ru/sitemap.xml

Warnings

  • `host` is not a known field.