Log In Sign Up

istartvalley.org
robots.txt

Robots Exclusion Standard data for istartvalley.org

Resource Scan

Scan Details

Site Domain istartvalley.org
Base Domain istartvalley.org
Scan Status Ok
Last Scan2025-09-07T03:49:20+00:00
Next Scan 2025-10-07T03:49:20+00:00

Last Scan

Scanned2025-09-07T03:49:20+00:00
URL https://istartvalley.org/robots.txt
Redirect https://www.istartvalley.org/robots.txt
Redirect Domain www.istartvalley.org
Redirect Base istartvalley.org
Domain IPs 50.87.190.90
Redirect IPs 50.87.190.90
Response IP 50.87.190.90
Found Yes
Hash b7e38c87b0efd85d4f1c362a316dc2d19ad0c97b94eea99ad7e84f2ba95fef1a
SimHash 6b1f1d5b49d6

Groups

*

Rule Path
Disallow /administrator/
Disallow /component/users/login
Back to top

Other Records

Field Value
sitemap https://www.istartvalley.org/sitemap.xml
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/orig.html
  • Disallow: /api/
  • Disallow: /bin/
  • Disallow: /cache/
  • Disallow: /cli/
  • Disallow: /components/
  • Disallow: /includes/
  • Disallow: /installation/
  • Disallow: /language/
  • Disallow: /layouts/
  • Disallow: /libraries/
  • Disallow: /logs/
  • Disallow: /modules/
  • Disallow: /plugins/
  • Disallow: /tmp/
Back to top