Log In Sign Up

unimal.ac.id
robots.txt

Robots Exclusion Standard data for unimal.ac.id

Resource Scan

Scan Details

Site Domain unimal.ac.id
Base Domain unimal.ac.id
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-03-20T03:10:10+00:00
Next Scan 2025-06-18T03:10:10+00:00

Last Successful Scan

Scanned2024-10-29T03:03:32+00:00
URL https://unimal.ac.id/robots.txt
Domain IPs 103.107.186.19
Response IP 103.107.186.19
Found Yes
Hash 5240f5ce4f997a3aa4201b8808346bc2df6093c72017527faf93d7838f383617
SimHash e21e1d5bc9f4

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /api/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Back to top

Other Records

Field Value
sitemap https://unimal.ac.id/index.php?option=com_jmap&view=sitemap&format=xml
sitemap https://unimal.ac.id/sitemap_xml.xml
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/orig.html
  • JSitemap entries
Back to top