Log In Sign Up

shop4sea.gr
robots.txt

Robots Exclusion Standard data for shop4sea.gr

Resource Scan

Scan Details

Site Domain shop4sea.gr
Base Domain shop4sea.gr
Scan Status Ok
Last Scan5/7/2025, 2:48:16 PM
Next Scan 6/6/2025, 2:48:16 PM

Last Scan

Scanned5/7/2025, 2:48:16 PM
URL https://shop4sea.gr/robots.txt
Redirect https://www.shop4sea.gr/robots.txt
Redirect Domain www.shop4sea.gr
Redirect Base shop4sea.gr
Domain IPs 213.158.90.29
Redirect IPs 213.158.90.29
Response IP 213.158.90.29
Found Yes
Hash 6869ca3d9099bebd29c8a388a0cf46d2c2ef686487ab3b2e2f7dc39421c9aa75
SimHash a31e9d5883a5

Groups

gptbot

Rule Path
Disallow /

babbar

Rule Path
Disallow /

barkrowler

No rules defined. All paths allowed.

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • User-agent: *
  • Disallow: /administrator/
  • Disallow: /cache/
  • Disallow: /cli/
  • Disallow: /components/
  • Disallow: /images/
  • Disallow: /includes/
  • Disallow: /installation/
  • Disallow: /language/
  • Disallow: /libraries/
  • Disallow: /logs/
  • Disallow: /media/
  • Disallow: /modules/
  • Disallow: /plugins/
  • Disallow: /templates/
  • Disallow: /tmp/
Back to top

Warnings

  • 1 invalid line.
Back to top