oceanus.ro
robots.txt

Robots Exclusion Standard data for oceanus.ro

Resource Scan

Scan Details

Site Domain oceanus.ro
Base Domain oceanus.ro
Scan Status Ok
Last Scan2025-12-20T20:13:37+00:00
Next Scan 2026-01-19T20:13:37+00:00

Last Scan

Scanned2025-12-20T20:13:37+00:00
URL https://oceanus.ro/robots.txt
Domain IPs 93.115.112.217
Response IP 93.115.112.217
Found Yes
Hash e01954cbad60758267d220c74ea9302dafdf18aff6e535e92e0f8c4017e984ec
SimHash 635470a44a17

Groups

*

Rule Path
Disallow
Disallow /admin/
Disallow /chat/
Disallow /guara/
Disallow /magonline/
Disallow /navigator/
Disallow /whois/

netmechanic

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

teleport

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

hotbot-lycos robot

Rule Path
Disallow

googlebot

Rule Path
Disallow

wget

Rule Path
Disallow

wisenut.com robot

Rule Path
Disallow

msie crawler

Rule Path
Disallow

almaden.ibm

Rule Path
Disallow

alexa robot

Rule Path
Disallow

appie

Rule Path
Disallow

libwww-perl

Rule Path
Disallow

psbot

Rule Path
Disallow

direct hit/ask/askjeeves robot

Rule Path
Disallow

whois.sc

Rule Path
Disallow

lwp-trivial

Rule Path
Disallow

altavista robot

Rule Path
Disallow

www.merl.com

Rule Path
Disallow

netcraft web server

Rule Path
Disallow

seed.net.tw search

Rule Path
Disallow

xenu link sleuth

Rule Path
Disallow

rrc

Rule Path
Disallow

yahooseeker

Rule Path
Disallow

thunderstone

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

scrubby

Rule Path
Disallow

robozilla

Rule Path
Disallow

becomebot

Rule Path
Disallow

nutch

Rule Path
Disallow

www.baidu.com

Rule Path
Disallow

mediacrawler

Rule Path
Disallow

lycos

Rule Path
Disallow

plantynet web robot

Rule Path
Disallow

link checker

Rule Path
Disallow

linkwalker

Rule Path
Disallow

abacho.com

Rule Path
Disallow

marvin

Rule Path
Disallow

vagabondo

Rule Path
Disallow

pompos

Rule Path
Disallow