ae-design.cn
robots.txt

Robots Exclusion Standard data for ae-design.cn

Resource Scan

Scan Details

Site Domain ae-design.cn
Base Domain ae-design.cn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-02T23:33:08+00:00
Next Scan 2024-12-01T23:33:08+00:00

Last Successful Scan

Scanned2024-07-12T23:31:40+00:00
URL http://ae-design.cn/robots.txt
Domain IPs 115.28.18.229
Response IP 115.28.18.229
Found Yes
Hash deff9a4b55cd2c2d0700500d7cfa9f17bcba6bb34d6feb2ea19e8d05f3ee1f09
SimHash a31e155843e5

Groups

*

Rule Path
Allow /

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • User-agent: *
  • Disallow: /administrator/
  • Disallow: /cache/
  • Disallow: /cli/
  • Disallow: /components/
  • Disallow: /images/
  • Disallow: /includes/
  • Disallow: /installation/
  • Disallow: /language/
  • Disallow: /libraries/
  • Disallow: /logs/
  • Disallow: /media/
  • Disallow: /modules/
  • Disallow: /plugins/
  • Disallow: /templates/
  • Disallow: /tmp/