rustaste.ru
robots.txt
Robots Exclusion Standard data for rustaste.ru
Resource Scan
Scan Details
| Site Domain | rustaste.ru |
| Base Domain | rustaste.ru |
| Scan Status | Ok |
| Last Scan | 2025-11-16T17:52:36+00:00 |
| Next Scan | 2025-11-23T17:52:36+00:00 |
Last Scan
| Scanned | 2025-11-16T17:52:36+00:00 |
| URL | https://rustaste.ru/robots.txt |
| Domain IPs | 2a03:f480:1:10::c3, 46.36.218.106 |
| Response IP | 46.36.218.106 |
| Found | Yes |
| Hash | ab489ada510b36e5c9887d362024244f186086b68fa15dd5fb641fcbfee4a028 |
| SimHash | 6b40cc728a93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /webstat/ |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */comments |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | /wp-admin/ |
| Disallow | /comments |
| Disallow | */embed* |
| Disallow | */wp-json* |
| Disallow | */feed |
yandex
| Rule | Path |
|---|---|
| Allow | /?yandex_feed=news |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /webstat/ |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */comments |
| Disallow | /wp-content/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /comments |
| Disallow | */embed* |
| Disallow | */wp-json* |
| Disallow | /*.html/amp |
| Disallow | */feed |
| Disallow | /?p=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rustaste.ru/sitemap.xml |
Warnings
- `host` is not a known field.