Log In Sign Up

jrwebmasters.net
robots.txt

Robots Exclusion Standard data for jrwebmasters.net

Resource Scan

Scan Details

Site Domain jrwebmasters.net
Base Domain jrwebmasters.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-06T13:50:21+00:00
Next Scan 2025-11-04T13:50:21+00:00

Last Successful Scan

Scanned2025-04-09T13:49:03+00:00
URL https://jrwebmasters.net/robots.txt
Redirect http://www.jrwebmasters.net/robots.txt
Redirect Domain www.jrwebmasters.net
Redirect Base jrwebmasters.net
Domain IPs 130.51.180.32
Redirect IPs 130.51.180.32
Response IP 130.51.180.32
Found Yes
Hash c29711f459dfd4d578c73d7127049db6c4fb62c9925426487edbe773e3e945c0
SimHash e21d151943f4

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/

googlebot

Rule Path
Allow /*.js*
Allow /*.css*
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • Disallow: /cache/
Back to top