winecountry.com.au
robots.txt

Robots Exclusion Standard data for winecountry.com.au

Resource Scan

Scan Details

Site Domain winecountry.com.au
Base Domain winecountry.com.au
Scan Status Ok
Last Scan2024-09-22T07:18:54+00:00
Next Scan 2024-10-22T07:18:54+00:00

Last Scan

Scanned2024-09-22T07:18:54+00:00
URL https://winecountry.com.au/robots.txt
Redirect https://www.winecountry.com.au/robots.txt
Redirect Domain www.winecountry.com.au
Redirect Base winecountry.com.au
Domain IPs 15.197.210.243, 3.33.207.19
Redirect IPs 13.33.88.10, 13.33.88.100, 13.33.88.113, 13.33.88.129, 2600:9000:223b:1000:1:d2d2:4200:93a1, 2600:9000:223b:3c00:1:d2d2:4200:93a1, 2600:9000:223b:5000:1:d2d2:4200:93a1, 2600:9000:223b:800:1:d2d2:4200:93a1, 2600:9000:223b:ae00:1:d2d2:4200:93a1, 2600:9000:223b:b600:1:d2d2:4200:93a1, 2600:9000:223b:ec00:1:d2d2:4200:93a1, 2600:9000:223b:f200:1:d2d2:4200:93a1
Response IP 13.33.88.100
Found Yes
Hash d03f4872b0e3971ef92158fc8e146eb55db06e937d8929bf7a2e26cb70c42c39
SimHash b31f1d58cbe5

Groups

*

Rule Path
Disallow /administrator/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/

Other Records

Field Value
sitemap http://www.winecountry.com.au/sitemap.xml

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html