Log In Sign Up

zdrowazywnosc.biz.pl
robots.txt

Robots Exclusion Standard data for zdrowazywnosc.biz.pl

Resource Scan

Scan Details

Site Domain zdrowazywnosc.biz.pl
Base Domain zdrowazywnosc.biz.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-17T17:33:04+00:00
Next Scan 2024-11-24T17:33:04+00:00

Last Successful Scan

Scanned2024-11-09T17:32:27+00:00
URL https://zdrowazywnosc.biz.pl/robots.txt
Redirect https://www.zdrowazywnosc.biz.pl/robots.txt
Redirect Domain www.zdrowazywnosc.biz.pl
Redirect Base zdrowazywnosc.biz.pl
Domain IPs 94.152.162.169
Redirect IPs 94.152.162.169
Response IP 94.152.162.169
Found Yes
Hash 17b445a6455bba14d6289f347647f8940c3a2b5aed799dd19b25d2476afc39cc
SimHash a31e155843e5

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1000

ahrefsbot

Rule Path
Disallow /

innybot

Rule Path
Disallow /
Disallow /administrator/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Back to top

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
Back to top