Log In Sign Up

moskvalux.ru
robots.txt

Robots Exclusion Standard data for moskvalux.ru

Resource Scan

Scan Details

Site Domain moskvalux.ru
Base Domain moskvalux.ru
Scan Status Ok
Last Scan2024-10-29T08:49:53+00:00
Next Scan 2024-11-05T08:49:53+00:00

Last Scan

Scanned2024-10-29T08:49:53+00:00
URL https://moskvalux.ru/robots.txt
Domain IPs 81.177.139.247
Response IP 81.177.139.247
Found Yes
Hash 3b8f4e216ecfe3ac8c87be34387641fff23aa4fda8cb784945b9cb41073c4567
SimHash 52079d5bc3f4

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /category/
Disallow /author/
Disallow /page/
Disallow */trackback
Disallow */comments
Disallow /*.php

yandex

Rule Path Comment
Disallow /cgi-bin блокирует доступ к страницам начинающиÑ
Disallow /wp-admin/ блокирует доступ к содержимому папки wp-admin
Disallow /wp-includes/ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Disallow /wp-trackback блокирует доступ к страницам начинающиÑ
Disallow /wp-feed -
Disallow /wp-comments -
Disallow /category/ -
Disallow /author/ -
Disallow /page/ -
Disallow */trackback -
Disallow */comments -
Disallow /*.php -

Other Records

Field Value Comment
crawl-delay 60 задает таймаут в 60 секунд
Back to top

Other Records

Field Value
sitemap http://moskvalux.ru/sitemap.xml
sitemap http://moskvalux.ru/sitemap.xml
sitemap http://moskvalux/sitemap.xml
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • блокирует содержимое папки plugins в каталоге wp-content
Back to top

Warnings

  • 2 invalid lines.
  • `host` is not a known field.
Back to top