joomlatemplates.co.uk
robots.txt

Groups

*

Other Records

Comments

• If the Joomla site is installed within a folder such as at
• e.g. www.example.com/joomla/ the robots.txt file MUST be
• moved to the site root at e.g. www.example.com/robots.txt
• AND the joomla folder name MUST be prefixed to the disallowed
• path, e.g. the Disallow rule for the /administrator/ folder
• MUST be changed to read Disallow: /joomla/administrator/
• For more information about the robots.txt standard,
• http://www.robotstxt.org/orig.html
• For syntax checking, see: robots.txt syntax checker
• http://tool.motoricerca.info/robots-checker.phtml
• Please don't remove folders from disallow.
• The allows at the top allow any of the mimetypes listed to be crawled within any folder
• using long-tail wildcards, these ignore the disallows for the folders below.
• This gives full render for the search engines whilst preventing full crawls of system
• folders
• THIS ALLOWS FULL RENDER AT ENGINES
• THESE FOLDERS SHOULD NEVER BE CRAWLED