Log In Sign Up

babushkinadacha.ru
robots.txt

Robots Exclusion Standard data for babushkinadacha.ru

Resource Scan

Scan Details

Site Domain babushkinadacha.ru
Base Domain babushkinadacha.ru
Scan Status Ok
Last Scan2024-11-12T14:14:25+00:00
Next Scan 2024-11-19T14:14:25+00:00

Last Scan

Scanned2024-11-12T14:14:25+00:00
URL https://babushkinadacha.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:3:0:253, 31.31.198.37
Response IP 31.31.198.37
Found Yes
Hash 9af97ddcf0abc874e491f1420a5721f0f609bca04e8487f343d98d20d8f8f8a5
SimHash c61cc47305ad

Groups

mediapartners-google

Rule Path
Disallow

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

mail.ru

Rule Path
Allow *.gif
Allow *.jpg
Allow *.jpeg
Allow *.png
Allow */feed/
Allow */feed
Allow /?feed=
Allow /feed/zen*

*

Rule Path
Disallow /administrator/
Disallow /components/
Disallow /cache/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Disallow /xmlrpc/
Disallow /*?sl*
Disallow /name.php?action=print
Disallow /trackback
Disallow /*atom.html
Disallow /component/search/
Disallow /component/mailto/
Disallow /component/user/
Disallow /xmlrpc/
Disallow /search/
Disallow /*.pdf
Disallow /*print%3D1
Disallow /*type%3Datom
Disallow /*type%3Drss
Disallow /*task%3Drss
Disallow /tag/
Disallow /index.php$
Disallow /home/$
Disallow /home.html$
Disallow /*?start=
Disallow /*?start
Allow /index.php?option=com_xmap&view=xml&id=1

Other Records

Field Value
crawl-delay 3

yandex

Rule Path
Allow /feed/zen*
Allow /journal/yandex.rss/all/
Allow /feed/turbo/
Back to top

Other Records

Field Value
sitemap https://babushkinadacha.ru/sitemap_index.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top