pensiology.ru
robots.txt
Robots Exclusion Standard data for pensiology.ru
Resource Scan
Scan Details
Site Domain | pensiology.ru |
Base Domain | pensiology.ru |
Scan Status | Ok |
Last Scan | 2025-04-30T06:05:17+00:00 |
Next Scan | 2025-05-07T06:05:17+00:00 |
Last Scan
Scanned | 2025-04-30T06:05:17+00:00 |
URL | https://pensiology.ru/robots.txt |
Domain IPs | 5.45.112.69 |
Response IP | 5.45.112.69 |
Found | Yes |
Hash | b6b4c5eb95d85a5873dadea2845bd3dcbf398e63e67354a1887565045ff572eb |
SimHash | 612e194a66b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/cache/ |
Disallow | /wp-content/languages/ |
Disallow | /wp-content/logs/ |
Disallow | /wp-content/themes/index.php |
Disallow | /wp-content/upgrade/ |
Disallow | /wp-content/advanced-cache.php |
Disallow | /wp-content/debug.log |
Disallow | /wp-content/index.php |
Disallow | /wp-content/wp-cache-config.php |
Disallow | /license.txt |
Disallow | /readme.html |
Disallow | /statistica.xlsx |
Disallow | /wp-activate.php |
Disallow | /wp-blog-header.php |
Disallow | /wp-comments-post.php |
Disallow | /wp-config-sample.php |
Disallow | /wp-config.php |
Disallow | /wp-cron.php |
Disallow | /wp-links-opml.php |
Disallow | /wp-load.php |
Disallow | /wp-login.php |
Disallow | /wp-mail.php |
Disallow | /wp-settings.php |
Disallow | /wp-signup.php |
Disallow | /wp-trackback.php |
Disallow | /xmlrpc.php |
Disallow | *attachment* |
Disallow | *comments* |
Disallow | *comment-page* |
Disallow | *trackback* |
Disallow | *trashed* |
Disallow | /?p= |
Disallow | /?page_id= |
Disallow | */?s=* |
Disallow | */?a=* |
Disallow | */?sa=* |
Disallow | */?fbclid=* |
Disallow | */?_thumbnail_id=* |
Disallow | */?preview=* |
Disallow | */?preview_id=* |
Disallow | */?replytocom=* |
Disallow | */?utm* |
Disallow | */?ref* |
Disallow | */?__cf_chl_captcha_tk* |
Disallow | */?_ym_debug=* |
Disallow | */feed/ |
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/cache/autoptimize/css/ |
Allow | /feed/zen* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://pensiology.ru/sitemap.xml |
Warnings
- `host` is not a known field.