stegantsov.com
robots.txt
Robots Exclusion Standard data for stegantsov.com
Resource Scan
Scan Details
| Site Domain | stegantsov.com |
| Base Domain | stegantsov.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-19T08:15:52+00:00 |
| Next Scan | 2026-03-19T08:15:52+00:00 |
Last Successful Scan
| Scanned | 2025-05-23T00:42:29+00:00 |
| URL | https://stegantsov.com/robots.txt |
| Domain IPs | 104.21.16.20, 172.67.165.246, 2606:4700:3033::ac43:a5f6, 2606:4700:3035::6815:1014 |
| Response IP | 172.67.165.246 |
| Found | Yes |
| Hash | ec1cc8e508d885c31318d2da39978cf5fa955d5e238885c3552485993075a977 |
| SimHash | 290868c71e79 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cgi-bin |
| Disallow | /wp-content/uploads/users |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.mp3 |
| Allow | /*?v* |
| Allow | /*?w* |
| Allow | /page-sitemap.xml |
| Disallow | /addtopic |
| Disallow | /addpost |
| Disallow | /index.php |
| Disallow | /tmp |
| Disallow | /license.txt |
| Disallow | /wp-activate.php |
| Disallow | /wp-blog-header.php |
| Disallow | /wp-comments-post.php |
| Disallow | /wp-config-sample.php |
| Disallow | /wp-config.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-links-opml.php |
| Disallow | /wp-load.php |
| Disallow | /wp-login.php |
| Disallow | /wp-mail.php |
| Disallow | /wp-settings.php |
| Disallow | /wp-signup.php |
| Disallow | /wp-trackback.php |
| Disallow | /xmlrpc.php |
| Disallow | /wp-register.php |
| Disallow | /wp-app.php |
| Disallow | /wp-json |
| Disallow | */comment-page-1 |
| Disallow | /comments |
| Disallow | */comments |
| Disallow | /index.php?s= |
| Disallow | */trackback |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | /*?replytocom |
| Disallow | /log*$ |
| Disallow | /goto*$ |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | */cart/ |
| Disallow | /sample-page/ |
| Disallow | */checkout/ |
| Disallow | /my-account/ |
| Disallow | /uncategorized/ |
| Disallow | /product-category/ |
| Disallow | /soglasie/ |
| Disallow | /vopros/$ |
| Disallow | /vopros/category/* |
| Disallow | /dwqa-answer/ |
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/uploads/wpcf7_captcha |
| Disallow | /author/ |
| Disallow | /course_category/ |
| Disallow | /blog/ |
| Disallow | /category/ |
| Disallow | */tag/ |
| Disallow | /shop/ |
| Disallow | /profile/ |
| Disallow | /project-cat/ |
| Disallow | /course-category/ |
| Disallow | /lesson-category/ |
| Disallow | /blog/ |
| Disallow | /topic-category/ |
| Disallow | /topic-tag/ |
| Disallow | /course-category/ |
| Disallow | /lesson-category/ |
| Disallow | /my-courses/ |
| Allow | /courses/ |
| Disallow | */page/ |
| Disallow | /course-tag/ |
| Disallow | /shop/ |
| Disallow | /wishlist/ |
| Disallow | /project-cat/ |
| Disallow | /christmas-maintenance/ |
| Disallow | /lesson-tag/ |
| Disallow | */embed |
| Disallow | */embed/ |
| Disallow | */editpost |
| Disallow | */addpost |
| Disallow | */wlwmanifest.xml |
| Disallow | /xmlrpc.php |
| Disallow | /readme.html |
| Allow | /news/ |
| Disallow | */amp/ |
| Disallow | */profile |
| Disallow | /portfolio/ |
| Disallow | */activity/ |
| Disallow | /forum/history/* |
| Disallow | */unread/ |
| Disallow | */%26sa%3D* |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cgi-bin |
| Disallow | /wp-content/uploads/users |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.mp3 |
| Allow | /*?v* |
| Allow | /*?w* |
| Allow | /page-sitemap.xml |
| Disallow | /addtopic |
| Disallow | /addpost |
| Disallow | /index.php |
| Disallow | /tmp |
| Disallow | /license.txt |
| Disallow | /wp-activate.php |
| Disallow | /wp-blog-header.php |
| Disallow | /wp-comments-post.php |
| Disallow | /wp-config-sample.php |
| Disallow | /wp-config.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-links-opml.php |
| Disallow | /wp-load.php |
| Disallow | /wp-login.php |
| Disallow | /wp-mail.php |
| Disallow | /wp-settings.php |
| Disallow | /wp-signup.php |
| Disallow | /wp-trackback.php |
| Disallow | /xmlrpc.php |
| Disallow | /wp-register.php |
| Disallow | /wp-app.php |
| Disallow | /wp-json |
| Disallow | */comment-page-1 |
| Disallow | /comments |
| Disallow | */comments |
| Disallow | /index.php?s= |
| Disallow | */trackback |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | /*?replytocom |
| Disallow | /log*$ |
| Disallow | /goto*$ |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | */cart/ |
| Disallow | /sample-page/ |
| Disallow | */checkout/ |
| Disallow | /my-account/ |
| Disallow | /uncategorized/ |
| Disallow | /product-category/ |
| Disallow | /soglasie/ |
| Disallow | /vopros/$ |
| Disallow | /vopros/category/* |
| Disallow | /dwqa-answer/ |
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/uploads/wpcf7_captcha |
| Disallow | /author/ |
| Disallow | /course_category/ |
| Disallow | /blog/ |
| Disallow | /category/ |
| Disallow | */tag/ |
| Disallow | /shop/ |
| Disallow | /profile/ |
| Disallow | /project-cat/ |
| Disallow | /course-category/ |
| Disallow | /lesson-category/ |
| Disallow | /blog/ |
| Disallow | /topic-category/ |
| Disallow | /topic-tag/ |
| Disallow | /course-category/ |
| Disallow | /lesson-category/ |
| Disallow | /my-courses/ |
| Allow | /courses/ |
| Disallow | /wp-includes/wlwmanifest.xml |
| Disallow | */page/ |
| Disallow | /course-tag/ |
| Disallow | /shop/ |
| Disallow | /wishlist/ |
| Disallow | /project-cat/ |
| Disallow | /christmas-maintenance/ |
| Disallow | /lesson-tag/ |
| Disallow | */embed |
| Disallow | */embed/ |
| Disallow | */wlwmanifest.xml |
| Disallow | /xmlrpc.php |
| Disallow | /readme.html |
| Allow | /news/ |
| Disallow | */profile |
| Disallow | /portfolio/ |
| Disallow | */activity/ |
| Disallow | /forum/history/* |
| Disallow | */unread/ |
| Disallow | */%26sa%3D* |
| Disallow | */editpost |
| Disallow | */addpost |
Other Records
| Field | Value |
|---|---|
| sitemap | https://stegantsov.com/sitemap_index.xml |
Warnings
- `host` is not a known field.