iota-world.org
robots.txt

Robots Exclusion Standard data for iota-world.org

Resource Scan

Scan Details

Site Domain iota-world.org
Base Domain iota-world.org
Scan Status Ok
Last Scan2025-12-27T01:04:31+00:00
Next Scan 2026-01-26T01:04:31+00:00

Last Scan

Scanned2025-12-27T01:04:31+00:00
URL https://iota-world.org/robots.txt
Domain IPs 34.149.36.179, 34.160.81.203, 35.190.31.54, 35.244.153.44
Response IP 35.190.31.54
Found Yes
Hash 038a8c1fa284f7df878285cb009b703371bcfe57b09a15351b899cb68855b3ed
SimHash a31b15380bf5

Groups

unknown robot

Rule Path
Disallow /

unknown robot (identified by empty user agent string)

Rule Path
Disallow /

unknown robot (identified by '*bot')

Rule Path
Disallow /

unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-)

Rule Path
Disallow /

yabrowser

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

babbarbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

*

Rule Path
Disallow /administrator/
Disallow /ajax_calls/
Disallow /assets/
Disallow /awards/
Disallow /bin/
Disallow /briefcase/
Disallow /cache/
Disallow /cgi-bin/
Disallow /cli/
Disallow /components/
Disallow /fpdf/
Disallow /fpdi/
Disallow /functions/
Disallow /images/
Disallow /includes/
Disallow /iotamaps/
Disallow /johan/
Disallow /kickstart/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /log/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /old_database_dumps/
Disallow /plugins/
Disallow /tcpdf/
Disallow /templates/
Disallow /tmp/
Disallow /users/
Disallow /vendor/

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml