Log In Sign Up

runelore.it
robots.txt

Robots Exclusion Standard data for runelore.it

Resource Scan

Scan Details

Site Domain runelore.it
Base Domain runelore.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-20T17:33:49+00:00
Next Scan 2026-01-18T17:33:49+00:00

Last Successful Scan

Scanned2025-06-22T19:41:18+00:00
URL https://runelore.it/robots.txt
Domain IPs 2a0c:79c0:3:b::4, 37.156.244.11
Response IP 37.156.244.11
Found Yes
Hash 533b22b3bad854a8be44c272071800448ee95da90620dd9abcdc2af23313d704
SimHash aa1e1d5bc3e7

Groups

*

Rule Path
Disallow /administrator/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/

googlebot

Rule Path
Allow .js
Allow .css

spbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

yandex

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

willybot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://runelore.it/sitemap.xml
Back to top

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • Sitemap
Back to top