autoustroistvo.ru
robots.txt
Robots Exclusion Standard data for autoustroistvo.ru
Resource Scan
Scan Details
| Site Domain | autoustroistvo.ru |
| Base Domain | autoustroistvo.ru |
| Scan Status | Ok |
| Last Scan | 2025-09-17T06:39:09+00:00 |
| Next Scan | 2025-09-24T06:39:09+00:00 |
Last Scan
| Scanned | 2025-09-17T06:39:09+00:00 |
| URL | http://autoustroistvo.ru/robots.txt |
| Domain IPs | 5.101.152.245 |
| Response IP | 5.101.152.245 |
| Found | Yes |
| Hash | 397e1268d0a73f0e02e7c5d121f6b9b66996063bb0b106babf2ee72d065e95fb |
| SimHash | ab48de7448b8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /component/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | |
| Disallow | /*.swf |
| Disallow | /*print%3D1 |
| Disallow | /*mailto/ |
| Disallow | /index.php? |
| Disallow | /index.php |
| Disallow | /index.html |
| Disallow | /home |
| Disallow | /blog/tag/* |
| Disallow | /blog/wp-login.php |
| Disallow | /blog/wp-register.php |
| Disallow | /blog/category/* |
| Disallow | /blog/wp-content/plugins |
| Disallow | /blog/wp-content/themes |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-includes/ |
| Disallow | /blog/comments |
| Disallow | /blog/?p* |
| Disallow | /blog/2012/ |
| Disallow | /blog/2013/ |
| Disallow | /blog/2014/ |
| Disallow | /blog/author/* |
| Disallow | /blog/?* |
| Disallow | /blog/feed/ |
| Disallow | /blog/trackback |
| Disallow | /blog/*/feed |
| Disallow | /blog/*/comments |
| Disallow | /blog/*?* |
| Disallow | /blog/*? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
yandex
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /component/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | |
| Disallow | /*.swf |
| Disallow | /*print%3D1 |
| Disallow | /*mailto/ |
| Disallow | /index.php? |
| Disallow | /index.php |
| Disallow | /index.html |
| Disallow | /home |
| Disallow | /blog/tag/* |
| Disallow | /blog/wp-login.php |
| Disallow | /blog/wp-register.php |
| Disallow | /blog/category/* |
| Disallow | /blog/wp-content/plugins |
| Disallow | /blog/wp-content/themes |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-includes/ |
| Disallow | /blog/comments |
| Disallow | /blog/?p* |
| Disallow | /blog/2012/ |
| Disallow | /blog/2013/ |
| Disallow | /blog/2014/ |
| Disallow | /blog/author/* |
| Disallow | /blog/?* |
| Disallow | /blog/feed/ |
| Disallow | /blog/trackback |
| Disallow | /blog/*/feed |
| Disallow | /blog/*/comments |
| Disallow | /blog/*?* |
| Disallow | /blog/*? |
Other Records
| Field | Value |
|---|---|
| sitemap | http://autoustroistvo.ru/sitemap.xml |
Warnings
- `host` is not a known field.