Log In Sign Up

meganesia.com.br
robots.txt

Robots Exclusion Standard data for meganesia.com.br

Resource Scan

Scan Details

Site Domain meganesia.com.br
Base Domain meganesia.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-31T12:20:24+00:00
Next Scan 2025-01-29T12:20:24+00:00

Last Successful Scan

Scanned2024-01-05T06:35:37+00:00
URL https://meganesia.com.br/robots.txt
Domain IPs 104.21.10.100, 172.67.162.184, 2606:4700:3031::ac43:a2b8, 2606:4700:3036::6815:a64
Response IP 172.67.162.184
Found Yes
Hash c504b1e55c7839844189c386970f050d7036d2b87deb6327bb58ae96c4c7a0af
SimHash f21c1d59c3f4

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Back to top

Other Records

Field Value
sitemap https://www.meganesia.com.br/index.php?option=com_jmap&view=sitemap&format=xml
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • JSitemap entries
Back to top