Log In Sign Up

cicoil.com
robots.txt

Robots Exclusion Standard data for cicoil.com

Resource Scan

Scan Details

Site Domain cicoil.com
Base Domain cicoil.com
Scan Status Ok
Last Scan4/20/2025, 4:30:39 PM
Next Scan 5/20/2025, 4:30:39 PM

Last Scan

Scanned4/20/2025, 4:30:39 PM
URL https://cicoil.com/robots.txt
Redirect https://www.cicoil.com/robots.txt
Redirect Domain www.cicoil.com
Redirect Base cicoil.com
Domain IPs 104.21.74.179, 172.67.160.237, 2606:4700:3034::6815:4ab3, 2606:4700:3034::ac43:a0ed
Redirect IPs 104.21.74.179, 172.67.160.237, 2606:4700:3034::6815:4ab3, 2606:4700:3034::ac43:a0ed
Response IP 172.67.160.237
Found Yes
Hash 997bbc4fa8d61fce8f0fcfa547311b8adf2d281168a3ce211527443310220880
SimHash a11f155d4765

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /w91-x34-21y
Disallow /w91
Disallow /*/w91-x34-21y
Disallow /*/w91
Disallow /w157-x34-21y-2
Disallow /w157
Disallow /*/w157-x34-21y
Disallow /*/w157
Disallow /w174-x34-21y-2
Disallow /w174
Disallow /*/w174-x34-21y
Disallow /*/w174
Disallow /w180-x34-21y-2
Disallow /w180
Disallow /*/w180-x34-21y
Disallow /*/w180
Back to top

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
Back to top