disota.ru
robots.txt

Robots Exclusion Standard data for disota.ru

Resource Scan

Scan Details

Site Domain disota.ru
Base Domain disota.ru
Scan Status Ok
Last Scan2024-06-29T08:59:37+00:00
Next Scan 2024-07-06T08:59:37+00:00

Last Scan

Scanned2024-06-29T08:59:37+00:00
URL https://disota.ru/robots.txt
Domain IPs 77.246.145.164
Response IP 77.246.145.164
Found Yes
Hash 833d118aae93d5702b1e5e8ec462e56a8488afddc7ca0a2584b6c1060f9915fc
SimHash ef355d340630

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow */trackback/
Disallow *?*
Disallow */comment
Disallow */attachment/*
Disallow /author/
Disallow */category/*
Disallow */print/
Disallow */page/
Disallow *possible__unsafe__site*
Disallow *.html/
Allow /wp-content/plugins/*/*?ver*
Allow /wp-includes/js/jquery/*?ver*
Allow /wp-content/themes/*?ver*
Allow /wp-content/themes/*/img/
Allow /wp-includes/js/*?ver=

Other Records

Field Value
crawl-delay 5

wprocketbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://disota.ru/sitemap.xml

Warnings

  • `host` is not a known field.