khstu.su
robots.txt

Robots Exclusion Standard data for khstu.su

Resource Scan

Scan Details

Site Domain khstu.su
Base Domain khstu.su
Scan Status Ok
Last Scan2026-02-28T19:12:49+00:00
Next Scan 2026-03-07T19:12:49+00:00

Last Scan

Scanned2026-02-28T19:12:49+00:00
URL https://khstu.su/robots.txt
Redirect https://www.khstu.su/robots.txt
Redirect Domain www.khstu.su
Redirect Base khstu.su
Domain IPs 104.21.71.172, 172.67.171.20, 2606:4700:3035::6815:47ac, 2606:4700:3035::ac43:ab14
Redirect IPs 104.21.71.172, 172.67.171.20, 2606:4700:3035::6815:47ac, 2606:4700:3035::ac43:ab14
Response IP 172.67.171.20
Found Yes
Hash 0906e34e927680544a1a19891ab7c3da30ee0fc8f64246e979c4244829b84b0b
SimHash 280aac60ceb3

Groups

*

Rule Path
Disallow /rus/print.php
Disallow /rus/*searchstr*
Disallow /print.php
Disallow /*searchstr*
Disallow /rus/w.php
Disallow /r/*
Disallow /f/%3F*

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap http://www.khstu.su/sitemap.xml

Comments

  • Disallow: /dru/*