Log In Sign Up

dsi.net.pl
robots.txt

Robots Exclusion Standard data for dsi.net.pl

Resource Scan

Scan Details

Site Domain dsi.net.pl
Base Domain dsi.net.pl
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-20T20:31:49+00:00
Next Scan 2024-10-19T20:31:49+00:00

Last Successful Scan

Scanned2024-06-22T20:29:55+00:00
URL https://dsi.net.pl/robots.txt
Domain IPs 178.211.137.184
Response IP 178.211.137.184
Found Yes
Hash 85829775204cf847ce8f87b4ec0e281c95d1d1daff6326a6dcb5cba662a012de
SimHash e21d1d1b03f4

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Allow /ads.txt
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
Back to top