Log In Sign Up

gazetaempregos.com.br
robots.txt

Robots Exclusion Standard data for gazetaempregos.com.br

Resource Scan

Scan Details

Site Domain gazetaempregos.com.br
Base Domain gazetaempregos.com.br
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-21T18:22:09+00:00
Next Scan 2024-11-20T18:22:09+00:00

Last Successful Scan

Scanned2024-07-24T18:19:44+00:00
URL https://gazetaempregos.com.br/robots.txt
Domain IPs 154.56.50.53
Response IP 154.56.50.53
Found Yes
Hash b0badb1a6e6cf7444fb0e354203aa0f662ade78b49ddc68d3a1b892214f7897a
SimHash e21f1d5949fc

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/orig.html
Back to top