astrg.ru
robots.txt
Robots Exclusion Standard data for astrg.ru
Resource Scan
Scan Details
Site Domain | astrg.ru |
Base Domain | astrg.ru |
Scan Status | Ok |
Last Scan | 2024-09-15T09:40:25+00:00 |
Next Scan | 2024-10-15T09:40:25+00:00 |
Last Scan
Scanned | 2024-09-15T09:40:25+00:00 |
URL | https://astrg.ru/robots.txt |
Domain IPs | 5.139.210.150 |
Response IP | 5.139.210.150 |
Found | Yes |
Hash | 5d198d46032079d668da55eb3b553a071fff837185ce626d38c24d229d7a60d0 |
SimHash | 634767702aa7 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes/ |
Disallow | /wp-login.php |
Disallow | /wp-content/plugins |
Disallow | /wp-register.php |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /wp-trackback |
Disallow | */trackback/ |
Disallow | /wp-feed |
Disallow | /wp-comments |
Disallow | */trackback |
Disallow | */feed |
Disallow | */comments |
Disallow | /search |
googlebot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /wp-includes/ |
Disallow | /xmlrpc.php |
Disallow | /wp-admin |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /wp-comments |
Disallow | */author/* |
Disallow | */trackback/ |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /search |
Disallow | */feed/ |
Disallow | */feed |
Disallow | /?feed= |
Disallow | /metki/ |
Disallow | */comments |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /wp-includes/ |
Disallow | /xmlrpc.php |
Disallow | /wp-admin |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /wp-comments |
Disallow | */author/* |
Disallow | */trackback/ |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /search |
Disallow | */feed/ |
Disallow | */feed |
Disallow | /?feed= |
Disallow | /metki/ |
Disallow | */comments |
Warnings
- 10 invalid lines.
- `host` is not a known field.