znai-pravo.ru
robots.txt

Robots Exclusion Standard data for znai-pravo.ru

Resource Scan

Scan Details

Site Domain znai-pravo.ru
Base Domain znai-pravo.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-16T01:45:04+00:00
Next Scan 2024-12-15T01:45:04+00:00

Last Successful Scan

Scanned2024-02-20T01:43:25+00:00
URL https://znai-pravo.ru/robots.txt
Domain IPs 95.163.238.163
Response IP 95.163.238.163
Found Yes
Hash 6b8bc38d674b49bc7a08bc9d1277b12999de87131777b7fb2b7ddae002582e46
SimHash 4b24ced706b0

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/js/*
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow *?s*
Disallow *?preview=true*
Disallow */trackback/
Disallow */feed
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow /wp-json*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/js/*
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow *?s*
Disallow *?preview=true*
Disallow */trackback/
Disallow */feed
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow /wp-json*
Allow /wp-content/uploads/

mail.ru

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/js/*
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow *?s*
Disallow *?preview=true*
Disallow */trackback/
Disallow */feed
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow /wp-json*
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/js/*
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow *?s*
Disallow *?preview=true*
Disallow */trackback/
Disallow */feed
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow /wp-json*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

*

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 40 задает таймаут в 40 секунд для всеÑ

Other Records

Field Value
sitemap http://znai-pravo.ru/sitemap.xml

Warnings

  • 2 invalid lines.
  • `host` is not a known field.