a-russia.ru
robots.txt

Robots Exclusion Standard data for a-russia.ru

Resource Scan

Scan Details

Site Domain a-russia.ru
Base Domain a-russia.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-15T12:54:24+00:00
Next Scan 2024-12-14T12:54:24+00:00

Last Successful Scan

Scanned2023-08-22T00:36:47+00:00
URL https://a-russia.ru/robots.txt
Domain IPs 104.21.31.31, 172.67.174.232, 2606:4700:3031::6815:1f1f, 2606:4700:3032::ac43:aee8
Response IP 104.21.31.31
Found Yes
Hash d7305a8edaea8495cd63fe169011be394d8fb8f46f7311f91524ded9146ca360
SimHash 4f314f720a78

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /webstat/
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /wp-content/cache
Disallow /author/
Disallow /?author
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /wp-json
Disallow /xmlrpc.php
Disallow *?s*
Disallow /search
Disallow /*?wpfpaction=*
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /webstat/
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /wp-content/cache
Disallow /author/
Disallow /?author=1
Disallow /?cat=*
Disallow */amp
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /wp-json
Disallow /xmlrpc.php
Disallow /?gf_page=upload
Disallow *?s*
Disallow /search
Disallow /*?wpfpaction=*
Allow /wp-admin/admin-ajax.php

mail.ru

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/js/*
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /wp-content/cache
Disallow *?s*
Disallow /search
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Allow /wp-content/uploads/
Allow /img/

googlebot-image

Rule Path
Allow /wp-content/uploads/
Allow /img/

yandeximages

Rule Path
Allow /wp-content/uploads/
Allow /img/

mediapartners-google

Rule Path
Disallow

adsbot-google*

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

interfaxscanbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://a-russia.ru/sitemap_index.xml

Warnings

  • `host` is not a known field.