ikee.lib.auth.gr
robots.txt

Robots Exclusion Standard data for ikee.lib.auth.gr

Resource Scan

Scan Details

Site Domain ikee.lib.auth.gr
Base Domain auth.gr
Scan Status Ok
Last Scan2024-11-11T22:36:23+00:00
Next Scan 2024-11-25T22:36:23+00:00

Last Scan

Scanned2024-11-11T22:36:23+00:00
URL https://ikee.lib.auth.gr/robots.txt
Domain IPs 155.207.201.104
Response IP 155.207.201.104
Found Yes
Hash 6d455da0582f0dd87e863ba4cd91e97fe980d5fd4ff69a06216399fdf1a41aec
SimHash c38fd022ea24

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /search
Disallow /search.py
Disallow /publiline.py
Disallow /yourbaskets
Disallow /yourbaskets/add
Disallow /youraccount
Disallow /yourmessages
Disallow /youralerts
Disallow /yourgroups
Disallow /oai2d/
Disallow /oai2d.py/
Disallow /search
Disallow /stats/
Disallow /submit/
Disallow /images/
Disallow /record/*/linkbacks/sendtrackback
Disallow /record/*/export/*
Disallow /*.gif$
Disallow /*.pdf$
Disallow /*/usage
Disallow /rss

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /cgi-bin/
Disallow /search
Disallow /search.py
Disallow /publiline.py
Disallow /yourbaskets
Disallow /yourbaskets/add
Disallow /youraccount
Disallow /yourmessages
Disallow /youralerts
Disallow /yourgroups
Disallow /oai2d/
Disallow /oai2d.py/
Disallow /search
Disallow /stats/
Disallow /submit/
Disallow /images/
Disallow /record/*/linkbacks/sendtrackback
Disallow /record/*/export/*
Disallow /*.gif$
Disallow /*.pdf$
Disallow /*/usage
Disallow /rss

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /search
Disallow /search.py
Disallow /publiline.py
Disallow /yourbaskets
Disallow /yourbaskets/add
Disallow /youraccount
Disallow /yourmessages
Disallow /youralerts
Disallow /yourgroups
Disallow /oai2d/
Disallow /oai2d.py/
Disallow /search
Disallow /stats/
Disallow /images/
Disallow /record/*/linkbacks/sendtrackback
Disallow /record/*/export/*
Disallow /*/usage
Disallow /rss

Other Records

Field Value
crawl-delay 5

turnitinbot

Rule Path
Disallow /cgi-bin/
Disallow /search
Disallow /search.py
Disallow /publiline.py
Disallow /yourbaskets
Disallow /yourbaskets/add
Disallow /youraccount
Disallow /yourmessages
Disallow /youralerts
Disallow /yourgroups
Disallow /oai2d/
Disallow /oai2d.py/
Disallow /search
Disallow /stats/
Disallow /images/
Disallow /record/*/linkbacks/sendtrackback
Disallow /record/*/export/*
Disallow /*/usage
Disallow /rss

Other Records

Field Value
crawl-delay 30

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

lcc

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

cliqzbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

bot for jce

Rule Path
Disallow /

botrighthere

Rule Path
Disallow /

webzip

Rule Path
Disallow /

larbin

Rule Path
Disallow /

b2w/0.1

Rule Path
Disallow /

copernic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-urllib/2.7

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

emailwolf 1.00

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

website quester

Rule Path
Disallow /

webzip

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

webauto

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

rma

Rule Path
Disallow /

libweb/clshttp

Rule Path
Disallow /

asterias

Rule Path
Disallow /

httplib

Rule Path
Disallow /

turingos

Rule Path
Disallow /

spanner

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

bullseye/1.0

Rule Path
Disallow /

mozilla/4.0 (compatible; bullseye; windows 95)

Rule Path
Disallow /

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

cherrypickerse/1.0

Rule Path
Disallow /

cherrypickerelite/1.0

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

foobot

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

botalot

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

microsoft url control - 6.00.8169

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

wget/1.14

Rule Path
Disallow /

wget/1.19.5 (linux-gnu)

Rule Path
Disallow /

wget

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

moget

Rule Path
Disallow /

hloader

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

blowfish/1.0

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

miixpc/4.2

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

propowerbot/2.14

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

tocrawl/urldispatcher

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

vci webviewer vci webviewer win32

Rule Path
Disallow /

vci

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

queryn metasearch

Rule Path
Disallow /

openfind data gatherer

Rule Path
Disallow /

openfind

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

repomonkey bait & tackle/v1.01

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

openbot

Rule Path
Disallow /

url control

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

kenjin spider

Rule Path
Disallow /

iron33/1.0.2

Rule Path
Disallow /

bookmark search tool

Rule Path
Disallow /

getright/4.2

Rule Path
Disallow /

fairad client

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

aqua_products

Rule Path
Disallow /

radiation retriever 1.1

Rule Path
Disallow /

flaming attackbot

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

perman

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

webzip/4.21

Rule Path
Disallow /

webzip/5.0

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

censysinspect/1.1

Rule Path
Disallow /

mozilla/5.0 (compatible; censysinspect/1.1; +https://about.censys.io/)

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

leikibot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ias-or/3.1

Rule Path
Disallow /

newspaper/0.2.8

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

scrapy/1.4.0 (+http://scrapy.org)

Rule Path
Disallow /

scrapy/2.4.1 (+https://scrapy.org)

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ccbot/3.1

Rule Path
Disallow /

proximic

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

criteobot/0.1 (+https://www.criteo.com/criteo-crawler/)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; +https://www.comscore.com/web-crawler)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; +http://www.proximic.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; https://www.comscore.com/web-crawler)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; http://www.proximic.com/info/spider.php)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; +https://www.comscore.com/web-crawler),gzip(gfe)

Rule Path
Disallow /

zoominfobot (zoominfobot at zoominfo dot com)

Rule Path
Disallow /

mozilla/5.0 (compatible; seznambot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)

Rule Path
Disallow /

mozilla/5.0 (compatible; heritrix/3.3.0-snapshot-20140702-2247 +http://archive.org/details/archive.org_bot)

Rule Path
Disallow /

heritrix/3.4.0

Rule Path
Disallow /

mozilla/5.0 (compatible; dotbot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mozilla/5.0 (compatible; semrushbot; +http://www.semrush.com/bot.html)

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-bm/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; semrushbot-bm/1.0; +http://www.semrush.com/bot.html)

Rule Path
Disallow /

mozilla/5.0 (compatible; blexbot/1.0; +http://webmeup-crawler.com/)

Rule Path
Disallow /

python-requests/2.6.0

Rule Path
Disallow /

python-requests/2.9.1

Rule Path
Disallow /

python-requests/2.18.4

Rule Path
Disallow /

python-requests/2.18.1

Rule Path
Disallow /

python-requests/2.21.0

Rule Path
Disallow /

python-requests/2.22.0

Rule Path
Disallow /

python-requests/2.23.0

Rule Path
Disallow /

python-requests/2.24.0

Rule Path
Disallow /

python-requests/2.11.0

Rule Path
Disallow /

python-requests/2.25.1

Rule Path
Disallow /

python-requests/2.26.0

Rule Path
Disallow /

python-requests/2.27.1

Rule Path
Disallow /

cpython/2.7.5

Rule Path
Disallow /

python/3.7 aiohttp/3.7.4.post0

Rule Path
Disallow /

python/3.5

Rule Path
Disallow /

python/3.9

Rule Path
Disallow /

aiohttp/2.0.2

Rule Path
Disallow /

aiohttp/3.8.1

Rule Path
Disallow /

httpx - open-source project

Rule Path
Disallow /

mozilla/5.0 (compatible; barkrowler/0.9; +https://babbar.tech/crawler)

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

recon

Rule Path
Disallow /

recon (github.com/jimmysawczuk/recon; similar to facebot, facebookexternalhit/1.1)

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

axios/0.19.2

Rule Path
Disallow /

zgrab/0.x

Rule Path
Disallow /

postmanruntime/7.19.0

Rule Path
Disallow /

postmanruntime/7.26.5

Rule Path
Disallow /

iframely/1.3.1

Rule Path
Disallow /

mozilla/5.0 (windows nt 6.3;compatible; leikibot/1.0; +http://www.leiki.com)

Rule Path
Disallow /

safari/605.1.15 (applebot/0.1; +http://www.apple.com/go/applebot)

Rule Path
Disallow /

applebot/0.1

Rule Path
Disallow /

test certificate info

Rule Path
Disallow /

semantic-visions.com crawler

Rule Path
Disallow /

mozilla/5.0 (x11; compatible; semantic-visions.com crawler; httpclient 4.5)

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

mozilla/5.0 (compatible) semanticscholarbot (+https://www.semanticscholar.org/crawler)

Rule Path
Disallow /

wordpress/5.8

Rule Path
Disallow /

wordpress/5.7.2

Rule Path
Disallow /

nesotebot/2.1

Rule Path
Disallow /

appengine-google

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

libwww-perl/6.55

Rule Path
Disallow /

mozilla/5.0 (compatible; nesotebot/2.1; +http://www.inoutscripts.com/bot.html)

Rule Path
Disallow /

masscan-ng/1.3

Rule Path
Disallow /

masscan-ng/1.3 (https://github.com/bi-zone/masscan-ng)

Rule Path
Disallow /

crowdtanglebot/1.0

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

mozilla/5.0 (compatible; seokicks; +https://www.seokicks.de/robot.html)

Rule Path
Disallow /

mojeekbot/0.10

Rule Path
Disallow /

mozilla/5.0 (compatible; mojeekbot/0.10; +https://www.mojeek.com/bot.html)

Rule Path
Disallow /

webgains-bot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)

Rule Path
Disallow /

yioopbot

Rule Path
Disallow /

velenpublicwebcrawler/1.0

Rule Path
Disallow /

l9tcpid/v1.0.0

Rule Path
Disallow /

ias-jp/3.1

Rule Path
Disallow /

mattermost-bot/1.1

Rule Path
Disallow /

gumgum-bot/1.0

Rule Path
Disallow /

gumgum-bot/1.0 (http://gumgum.com; support@gumgum.com)

Rule Path
Disallow /

checklinks/1.3

Rule Path
Disallow /

checklinks/1.3 (dispenserbot; +http://dispenser.info.tm/~dispenser/view/checklinks)

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

mozilla/5.0 (compatible; adscanner/)/1.0 (http://seocompany.store; spider@seocompany.store)

Rule Path
Disallow /

slackbot-linkexpanding 1.0

Rule Path
Disallow /

slackbot-linkexpanding 1.0 (+https://api.slack.com/robots)

Rule Path
Disallow /

um-ln/1.0

Rule Path
Disallow /

ias crawler (ias_crawler; http://integralads.com/site-indexing-policy/)

Rule Path
Disallow /

ias crawler

Rule Path
Disallow /

slackbot-linkexpanding 1.0 (+https://api.slack.com/robots)

Rule Path
Disallow /

slack-imgproxy (+https://api.slack.com/robots)

Rule Path
Disallow /

slack-imgproxy

Rule Path
Disallow /

mozilla/5.0 (compatible; surdotlybot/1.0; +http://sur.ly/bot.html)

Rule Path
Disallow /

surdotlybot/1.0

Rule Path
Disallow /

crawlson/1.0

Rule Path
Disallow /

onalyticabot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

nimbostratus

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

domcopbot

Rule Path
Disallow /

traackr

Rule Path
Disallow /

bomborabot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

webtechbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

sbl-bot

Rule Path
Disallow /

df bot 1.0

Rule Path
Disallow /

bvbot

Rule Path
Disallow /

pubmatic crawler bot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

tpradstxtcrawler/1.1

Rule Path
Disallow /

adsbot/3.1

Rule Path
Disallow /

mozilla/5.0 (compatible; adsbot/3.1; +https://seostar.co/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; startmebot/1.0; +https://start.me/bot)

Rule Path
Disallow /

startmebot/1.0

Rule Path
Disallow /

reactornetty/1.0.4

Rule Path
Disallow /

node-fetch/1.0

Rule Path
Disallow /

webprosbot/2.0

Rule Path
Disallow /

lua-resty-http/0.10

Rule Path
Disallow /

alexa site audit/1.0

Rule Path
Disallow /

weborama-fetcher (+http://www.weborama.com)

Rule Path
Disallow /

rivva

Rule Path
Disallow /

mozilla/5.0 (compatible; crawlson/1.0; +https://www.crawlson.com/search?q=site:e-nomothesia.gr)

Rule Path
Disallow /

expanse_indexes_the_network_perimeters_of_our_customers._if_you_have_any_questions_or_concerns_please_reach_out_to:_scaninfo@expanseinc.com

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)

Rule Path
Disallow /

seo scanner/1.2.4 (seo crawler; seoscanners.info; info@seoscanners.info)

Rule Path
Disallow /