kustroz.ru
robots.txt
Robots Exclusion Standard data for kustroz.ru
Resource Scan
Scan Details
| Site Domain | kustroz.ru |
| Base Domain | kustroz.ru |
| Scan Status | Ok |
| Last Scan | 2025-03-28T14:10:39+00:00 |
| Next Scan | 2025-04-04T14:10:39+00:00 |
Last Scan
| Scanned | 2025-03-28T14:10:39+00:00 |
| URL | https://kustroz.ru/robots.txt |
| Domain IPs | 104.21.62.204, 172.67.139.61, 2606:4700:3030::ac43:8b3d, 2606:4700:3034::6815:3ecc |
| Response IP | 172.67.139.61 |
| Found | Yes |
| Hash | 4dd102da1a1b67767e7cf964e63fa186b37aa8fc4a7fa9fd05c63f140cfbdac7 |
| SimHash | 6b51df77469a |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /search |
| Disallow | /*? |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /goto/ |
| Disallow | /friends.php* |
| Disallow | /links.php* |
| Disallow | */page/* |
| Disallow | /page/1/ |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */tag/* |
| Disallow | */attachment/* |
| Disallow | /?_openstat* |
| Disallow | /audio |
| Disallow | /saper |
| Disallow | /annahelp |
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/uploads/*/*/?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /search |
| Disallow | /*? |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /goto/ |
| Disallow | /friends.php* |
| Disallow | /links.php* |
| Disallow | */page/* |
| Disallow | /page/1/ |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */tag/* |
| Disallow | */attachment/* |
| Disallow | /?_openstat* |
| Disallow | /audio |
| Disallow | /saper |
| Disallow | /annahelp |
| Allow | /wp-content/uploads/ |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /search |
| Disallow | /*? |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | /goto/ |
| Disallow | /friends.php* |
| Disallow | /links.php* |
| Disallow | */page/* |
| Disallow | /page/1/ |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */tag/* |
| Disallow | */attachment/* |
| Disallow | /?_openstat* |
| Disallow | /audio |
| Disallow | /saper |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://kustroz.ru/sitemap.xml |
Warnings
- `host` is not a known field.