Log In Sign Up

cybertron.in.th
robots.txt

Robots Exclusion Standard data for cybertron.in.th

Resource Scan

Scan Details

Site Domain cybertron.in.th
Base Domain cybertron.in.th
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-13T16:19:32+00:00
Next Scan 2026-01-11T16:19:32+00:00

Last Successful Scan

Scanned2023-06-27T14:50:46+00:00
URL https://cybertron.in.th/robots.txt
Domain IPs 103.246.18.11, 2401:5700:503:3333::1
Response IP 103.246.18.11
Found Yes
Hash 03e6e537a3b7d478090d8439af6ad8de395e414ebb23696a71bc04b2be204583
SimHash f21e1d1b49f4

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/orig.html
Back to top