sustavkoleni.ru
robots.txt

Robots Exclusion Standard data for sustavkoleni.ru

Resource Scan

Scan Details

Site Domain sustavkoleni.ru
Base Domain sustavkoleni.ru
Scan Status Ok
Last Scan2024-09-19T17:44:41+00:00
Next Scan 2024-09-26T17:44:41+00:00

Last Scan

Scanned2024-09-19T17:44:41+00:00
URL http://sustavkoleni.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:1:240, 2a00:15f8:a000:5:1:12:1:240, 2a00:15f8:a000:5:1:13:1:240, 2a00:15f8:a000:5:1:14:1:240, 90.156.201.123, 90.156.201.45, 90.156.201.65, 90.156.201.76
Response IP 90.156.201.45
Found Yes
Hash c26aa9af115af94640e3f02aeb5e6a048e7e9c8c8e526167b2b6f41cf6608656
SimHash 6f20de670630

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow /?s=
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */filter*
Disallow *?
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow /?s=
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */filter*
Disallow *?
Allow /wp-content/uploads/

mail.ru

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow /?s=
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */filter*
Disallow *?
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow /?s=
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */filter*
Disallow *?
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap http://sustavkoleni.ru/sitemap.xml

Warnings

  • `host` is not a known field.