autodostoinstvo.ru
robots.txt

Robots Exclusion Standard data for autodostoinstvo.ru

Resource Scan

Scan Details

Site Domain autodostoinstvo.ru
Base Domain autodostoinstvo.ru
Scan Status Ok
Last Scan2024-09-24T14:05:54+00:00
Next Scan 2024-10-01T14:05:54+00:00

Last Scan

Scanned2024-09-24T14:05:54+00:00
URL https://autodostoinstvo.ru/robots.txt
Domain IPs 45.130.41.88
Response IP 45.130.41.88
Found Yes
Hash 76891e4d5e9ba26da6c1dab7b517de15cc21aa04fe138334d76985df06953190
SimHash 6f78f44286c6

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /vote
Disallow /vote/
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /*?
Disallow /?s=
Disallow /tag
Disallow /search
Disallow /search/
Disallow /search.php
Disallow /?searchid=
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /webstat/
Disallow /category/
Disallow /xmlrpc.php

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /vote
Disallow /vote/
Disallow */*/feed/*/
Disallow */feed
Disallow */amp
Disallow /page/
Disallow /*?*
Disallow /*?
Disallow /?s=
Disallow /tag
Disallow /search
Disallow /search/
Disallow /search.php
Disallow /?searchid=
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /webstat/
Disallow /category/
Disallow /xmlrpc.php

Other Records

Field Value
crawl-delay 6

Other Records

Field Value
sitemap https://autodostoinstvo.ru/sitemap.xml
sitemap https://autodostoinstvo.ru/sitemap.xml

Warnings

  • `host` is not a known field.