molodaja-semja.ru
robots.txt
Robots Exclusion Standard data for molodaja-semja.ru
Resource Scan
Scan Details
| Site Domain | molodaja-semja.ru |
| Base Domain | molodaja-semja.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-11T20:57:39+00:00 |
| Next Scan | 2024-11-18T20:57:39+00:00 |
Last Scan
| Scanned | 2024-11-11T20:57:39+00:00 |
| URL | https://molodaja-semja.ru/robots.txt |
| Redirect | http://molodaja-semja.ru/robots.txt |
| Domain IPs | 5.45.123.221 |
| Response IP | 5.45.123.221 |
| Found | Yes |
| Hash | 4509fa7b21d62042cf93f03fb32bc6550e6898516b385d6ddb532776817db329 |
| SimHash | 772650ca66b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /webstat/ |
| Disallow | /wp-content/cache/blogs/ |
| Disallow | /wp-content/cache/meta/ |
| Disallow | /wp-content/languages/ |
| Disallow | /wp-content/themes/index.php |
| Disallow | /wp-content/upgrade/ |
| Disallow | /wp-content/advanced-cache.php |
| Disallow | /wp-content/index.php |
| Disallow | /wp-content/wp-cache-config.php |
| Disallow | /wp-includes/ |
| Disallow | /searchreplacedb2.php |
| Disallow | /wp-activate.php |
| Disallow | /wp-blog-header.php |
| Disallow | /wp-comments-post.php |
| Disallow | /wp-config-sample.php |
| Disallow | /wp-config.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-links-opml.php |
| Disallow | /wp-load.php |
| Disallow | /wp-login.php |
| Disallow | /wp-mail.php |
| Disallow | /wp-settings.php |
| Disallow | /wp-signup.php |
| Disallow | /wp-trackback.php |
| Disallow | /xmlrpc.php |
| Disallow | /author/ |
| Disallow | /node/* |
| Disallow | */feed/ |
| Disallow | /?s= |
| Disallow | /?p= |
| Disallow | /?page_id= |
| Disallow | */?fbclid=* |
| Disallow | */?sa=* |
| Disallow | */?_thumbnail_id=* |
| Disallow | */?preview=* |
| Disallow | */?preview_id=* |
| Disallow | */?replytocom=* |
| Disallow | */?ivid=* |
| Disallow | */?utm* |
| Disallow | */?utf* |
| Disallow | */?amp* |
| Disallow | */?app* |
| Disallow | */?ttc* |
| Disallow | */?ids* |
| Disallow | */?trashed* |
| Disallow | */?ref* |
| Disallow | */?__cf_chl_captcha_tk* |
| Disallow | */?scrn* |
| Disallow | */?w3tc_note* |
| Disallow | *attachment* |
| Disallow | *comments* |
| Disallow | *comment-page* |
| Disallow | *trackback* |
| Disallow | *_sm_byp* |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://molodaja-semja.ru/sitemap.xml |
Warnings
- `host` is not a known field.