Log In Sign Up

babylonberlin.de
robots.txt

Robots Exclusion Standard data for babylonberlin.de

Resource Scan

Scan Details

Site Domain babylonberlin.de
Base Domain babylonberlin.de
Scan Status Ok
Last Scan2025-03-25T03:15:04+00:00
Next Scan 2025-04-24T03:15:04+00:00

Last Scan

Scanned2025-03-25T03:15:04+00:00
URL https://babylonberlin.de/robots.txt
Redirect http://babylonberlin.eu//robots.txt
Redirect Domain babylonberlin.eu
Redirect Base babylonberlin.eu
Domain IPs 2001:8d8:100f:f000::2cf, 217.160.0.30
Redirect IPs 85.214.144.47
Response IP 85.214.144.47
Found Yes
Hash 07fddda1c13800931fb3faf6c3c028e332156c26744e42667852fdb38206b3bb
SimHash 621d051347f4

Groups

*

Rule Path
Allow /*.js*
Allow /*.css
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Allow /components/?.js
Allow /components/?.css
Allow /modules/?.js
Allow /modules/?.css
Allow /plugins/?.js
Allow /plugins/?.css
Allow /templates/?.js
Allow /templates/?.css
Allow /*?assets%2F*
Allow /*%26assets/*
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Back to top

Other Records

Field Value
sitemap https://www.babylonberlin.eu/component/osmap/?view=xml&id=3
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
Back to top