Log In Sign Up

металлолом.рф
robots.txt

Robots Exclusion Standard data for металлолом.рф

Resource Scan

Scan Details

Site Domain металлолом.рф
Base Domain металлолом.рф
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-17T05:52:00+00:00
Next Scan 2025-11-15T05:52:00+00:00

Last Successful Scan

Scanned2024-04-24T20:42:36+00:00
URL http://металлолом.рф/robots.txt
Redirect http://xn--80ajtaabfob8a.xn--p1ai/robots.txt
Domain IPs 91.189.114.15
Response IP 91.189.114.15
Found Yes
Hash efb17b3a75f11021387609be4ee5a3f4bb8ee5a2fad33a46ee729ccaaa055db9
SimHash a31f155947e5

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Back to top

Other Records

Field Value
sitemap http://xn--80ajtaabfob8a.xn--p1ai/index.php?option=com_xmap&view=xml&tmpl=component&id=1
Back to top

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
Back to top

Warnings

  • `host` is not a known field.
Back to top