country-food.ru
robots.txt

Robots Exclusion Standard data for country-food.ru

Resource Scan

Scan Details

Site Domain country-food.ru
Base Domain country-food.ru
Scan Status Ok
Last Scan2024-09-14T21:26:56+00:00
Next Scan 2024-10-14T21:26:56+00:00

Last Scan

Scanned2024-09-14T21:26:56+00:00
URL http://country-food.ru/robots.txt
Domain IPs 46.254.21.127
Response IP 46.254.21.127
Found Yes
Hash a1a6ba89ee916670971caf6b8f520e57f90dd58c35544761599927c9560cb24c
SimHash 69558161c799

Groups

*
yandex

Rule Path
Allow *

googlebot

Rule Path
Allow *

bingbot

Rule Path
Allow *

googlebot-image

Rule Path
Allow *

yandexnews

Rule Path
Allow *

yandexaddurl

Rule Path
Allow *

yandexblogs

Rule Path
Allow *

yandeximages

Rule Path
Allow *

slurp

Rule Path
Allow *

msnbot

Rule Path
Allow *

teoma

Rule Path
Allow *

lycos

Rule Path
Allow *

stackrambler

Rule Path
Allow *

mail.ru
googlebot-image

Rule Path
Allow *

yandeximages

Rule Path
Allow */trackback
Allow /search/
Allow */rss
Allow /?

bingbot

Rule Path
Allow *

slurp

Rule Path
Allow *

mail.ru

Rule Path
Allow *

googlebot-video

Rule Path
Allow *

yandexbot

Rule Path
Allow *

yandeximages

Rule Path
Allow *

yandexvideo

Rule Path
Allow *

yandexmedia

Rule Path
Allow *

yandexblogs

Rule Path
Allow *
Allow *?s=
Allow /category/$

allow: * .jpg
allow: * .gif
allow: * .png
allow: * .doc
allow: * .doc
allow: * .gif
allow: * .jpeg
allow: * .jpg
allow: * .pdf
allow: * .al
allow: * .cdr
allow: * .pdf
allow: * .odt
allow: * .sxw
allow: * .xlsx
allow: * .sxc
allow: * .xml

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/

Other Records

Field Value
sitemap http://country-food.ru/enter.delete.xml
sitemap http://country-food.ru/sitemap.xml
sitemap http://www.country-food.ru/sitemap.xml
sitemap http://country-food.ru/sitemap.xml

Warnings

  • `host` is not a known field.