hack2learn.org
robots.txt

Groups

googlebot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
apis-google
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
bingbot
jetmon

ahrefsbot
ahrefssiteaudit
aihitbot
admantx-euaspb
archive.org_bot
backlinkcrawler
blexbot
bomborabot
bubing
bytespider
ccbot
daum
deepcrawl
dotbot
ecairn-grabber
ecairn-grabber/1.0
echocrawl 2.0
eyeotabot
genieo
go-http-client
grapeshot
ia_archiver
istellabot/t.1.13
java/1.8.0_111
liebaofast
magpie-crawler
mail.ru_bot
mb2345browser
metajobbot
mj12bot
mlbot
mojeekbot
netcraftsurveyagent
qwantify
rytebot
scoutjet
seekbot
seekport
searchmetricbot
searchmetricsbot
semrushbot
semrushbot-sa
sentibot
sistrix
seokicks
serpstatbot
seznambot
skreemrbot
stc-bot
trident
webcapture
wget
xovi
yandexbot
zgrab
zoombot
zoominfobot

Other Records

Comments

• __ __ ___ __
• _ ___ ___ __ / / ___ _____/ /__ |_ |/ /__ ___ ________ ___ _______ _
• | |/|/ / |/|/ / |/|/ / / _ \/ _ `/ __/ '_// __// / -_) _ `/ __/ _ \_/ _ \/ __/ _ `/
• |__,__/|__,__/|__,__(_)_//_/\_,_/\__/_/\_\/____/_/\__/\_,_/_/ /_//_(_)___/_/ \_, /
• /___/
• By accessing hack2learn's website you agree to hack2learn's Terms of Service, available at
• https://www.hack2learn.org/kontakt/datenschutzerklaerung
• If you would like to inquire about crawling hack2learn, please contact us at
• https://www.hack2learn.org/kontakt
• As always, Asimov's Three Laws are in effect:
• 1. A robot may not injure a human being or, through inaction, allow a human
• being to come to harm.
• 2. A robot must obey orders given it by human beings except where such
• orders would conflict with the First Law.
• 3. A robot must protect its own existence as long as such protection does
• not conflict with the First or Second Law.
• o
• |
• ,'~'.
• / \
• | ____|_
• | '___,,_' .----------------.
• | ||(o |o)| ( KILL ALL HUMANS! )
• | ------- ,----------------'
• | _____| -'
• \ '####,
• -------
• /________\
• ( ) |)
• '_ ' ,------|\ _
• /_ / | |_\ ||
• /_ /| | o| _\ _||
• /_ / | | |\ _\____//' |
• ( ( | | | (_,_,_,____/
• \ _\ | ------|
• \ _\|_________|
• \ _\ \__\\__\
• |__| |__||__|
• ||/__/ |__||__|
• |__||__|
• |__||__|
• /__)/__)
• /__//__/
• /__//__/
• /__//__/.
• .' '. '.
• (________)____)
• Google adsbot ignores robots.txt unless specifically named!