ru.stegmax.com
robots.txt

Robots Exclusion Standard data for ru.stegmax.com

Resource Scan

Scan Details

Site Domain ru.stegmax.com
Base Domain stegmax.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-01T00:21:45+00:00
Next Scan 2024-06-15T00:21:45+00:00

Last Successful Scan

Scanned2024-04-23T22:37:09+00:00
URL https://ru.stegmax.com/robots.txt
Domain IPs 104.26.6.19, 104.26.7.19, 172.67.74.218, 2606:4700:20::681a:613, 2606:4700:20::681a:713, 2606:4700:20::ac43:4ada
Response IP 104.26.7.19
Found Yes
Hash 8c2ef355365d66d8c4f80f7dbacb12a6d12a941285756d94ce917c6d030c06e4
SimHash 2900f8c71a79

Groups

yandex

Rule Path
Allow /
Disallow /cgi-bin
Disallow /yookassa/*
Disallow /wp-content/uploads/users
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /*?v*
Allow /*?w*
Allow /page-sitemap.xml
Disallow /index.php
Disallow /tmp
Disallow /license.txt
Disallow /wp-activate.php
Disallow /wp-blog-header.php
Disallow /wp-comments-post.php
Disallow /wp-config-sample.php
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /wp-mail.php
Disallow /wp-settings.php
Disallow /wp-signup.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php
Disallow /wp-register.php
Disallow /wp-app.php
Disallow /wp-json
Disallow */comment-page-1
Disallow /comments
Disallow */comments
Disallow /index.php?s=
Disallow */trackback
Disallow /*?*
Disallow /*?
Disallow /*?replytocom
Disallow /log*$
Disallow /goto*$
Disallow */*/feed/*/
Disallow */feed
Disallow */cart/
Disallow /sample-page/
Disallow */checkout/
Disallow /my-account/
Disallow /uncategorized/
Disallow /product-category/
Disallow /soglasie/
Disallow /blog/
Disallow /category/
Allow /tag/
Allow /kbtag/
Disallow /topic-category/
Disallow /topic-tag/
Disallow /course-category/
Disallow /lesson-category/
Disallow /lesson-tag/
Disallow /my-courses/
Disallow /mkb_faq_category/
Disallow */page/
Disallow /course-tag/
Disallow /shop/
Disallow /notes/
Disallow /wishlist/
Disallow /project-cat/
Disallow /blog/
Disallow /christmas-maintenance/
Disallow */embed
Disallow */embed/
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /kurs/$
Disallow /custom-404/
Disallow /tables/$
Disallow /membership-account/
Allow */general-english-course-beginner-1/
Disallow /urok/$
Disallow /tests/$
Disallow /tema/$
Disallow */amp/
Disallow /terms/
Disallow /author/
Disallow /blog/
Disallow /shop/
Disallow /active/
Disallow /tables/
Disallow /terms-and-conditions/

*

Rule Path
Allow /
Disallow /cgi-bin
Disallow /yookassa/*
Disallow /wp-content/uploads/users
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /*?v*
Allow /*?w*
Allow /page-sitemap.xml
Disallow /index.php
Disallow /tmp
Disallow /license.txt
Disallow /wp-activate.php
Disallow /wp-blog-header.php
Disallow /wp-comments-post.php
Disallow /wp-config-sample.php
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /wp-mail.php
Disallow /wp-settings.php
Disallow /wp-signup.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php
Disallow /wp-register.php
Disallow /wp-app.php
Disallow /wp-json
Disallow */comment-page-1
Disallow /comments
Disallow */comments
Disallow /index.php?s=
Disallow */trackback
Disallow /*?*
Disallow /*?
Disallow /*?replytocom
Disallow /log*$
Disallow /goto*$
Disallow */*/feed/*/
Disallow */feed
Disallow */cart/
Disallow /sample-page/
Disallow */checkout/
Disallow /my-account/
Disallow /uncategorized/
Disallow /product-category/
Disallow /soglasie/
Disallow /blog/
Disallow /category/
Allow /tag/
Allow /kbtag/
Disallow /topic-category/
Disallow /topic-tag/
Disallow /course-category/
Disallow /lesson-category/
Disallow /lesson-tag/
Disallow /my-courses/
Disallow /mkb_faq_category/
Disallow */page/
Disallow /course-tag/
Disallow /shop/
Disallow /notes/
Disallow /wishlist/
Disallow /project-cat/
Disallow /blog/
Disallow /christmas-maintenance/
Disallow */embed
Disallow */embed/
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /kurs/$
Disallow /custom-404/
Disallow /membership-account/
Disallow */general-english-course-*
Disallow /tables/$
Disallow /urok/$
Disallow /tests/$
Disallow /tema/$
Disallow */turbo/
Disallow /terms/
Disallow /author/
Disallow /blog/
Disallow /shop/
Disallow /terms-and-conditions/
Disallow /active/
Disallow /tables/

dotbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google

Rule Path
Disallow
Allow /*

aggregator:spinn3r

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ru.stegmax.com/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.