avto-sovet.ru
robots.txt

Robots Exclusion Standard data for avto-sovet.ru

Resource Scan

Scan Details

Site Domain avto-sovet.ru
Base Domain avto-sovet.ru
Scan Status Ok
Last Scan2025-05-10T08:13:41+00:00
Next Scan 2025-05-17T08:13:41+00:00

Last Scan

Scanned2025-05-10T08:13:41+00:00
URL https://avto-sovet.ru/robots.txt
Domain IPs 45.130.41.99
Response IP 45.130.41.99
Found Yes
Hash a2a992a4c2b124cd86009826713a13c50cd7d01bae37d62d0f854d0696545cf9
SimHash 4a48d9d0c738

Groups

*

Rule Path
Disallow /?blackhole
Allow /wp-content/uploads/
Disallow /wp-
Disallow /cgi-bin
Disallow /author/
Disallow /xmlrpc.php
Disallow /tag/
Disallow /category/
Disallow /page/
Disallow /archive/
Disallow /*?tag=
Disallow /*?cat=
Disallow /*?paged=
Disallow /*?m=
Disallow /*feed
Disallow /*comments
Disallow /*trackback
Disallow /*comment-page
Disallow /*cpage%3D
Disallow /*?s=
Disallow /*%26s%3D

Other Records

Field Value
crawl-delay 11

yandex

Rule Path
Allow /wp-content/uploads/
Disallow /wp-
Disallow /cgi-bin
Disallow /author/
Disallow /xmlrpc.php
Disallow /tag/
Disallow /category/
Disallow /page/
Disallow /archive/
Disallow /*?tag=
Disallow /*?cat=
Disallow /*?paged=
Disallow /*?m=
Disallow /*feed
Disallow /*comments
Disallow /*trackback
Disallow /*comment-page
Disallow /*cpage%3D
Disallow /*?s=
Disallow /*%26s%3D

Other Records

Field Value
crawl-delay 11

Other Records

Field Value
sitemap https://avto-sovet.ru/sitemap.xml

Warnings

  • `host` is not a known field.