ijaminecraft.com
robots.txt

Robots Exclusion Standard data for ijaminecraft.com

Resource Scan

Scan Details

Site Domain ijaminecraft.com
Base Domain ijaminecraft.com
Scan Status Ok
Last Scan2024-06-10T16:46:25+00:00
Next Scan 2024-06-17T16:46:25+00:00

Last Scan

Scanned2024-06-10T16:46:25+00:00
URL https://ijaminecraft.com/robots.txt
Domain IPs 62.68.75.205
Response IP 62.68.75.205
Found Yes
Hash 95333103279a1191d1601953dab64deff8289bb90a8b9169f37be183dc8314a8
SimHash 6b03703308a7

Groups

*

Rule Path
Disallow /de/urheberrecht
Disallow /en/copyright
Disallow /de/impressum
Disallow /en/legal-notice
Disallow /de/datenschutz
Disallow /en/privacy
Disallow /de/nutzungsbedingungen
Disallow /en/terms
Disallow /error-page
Disallow /offline-page
Allow /

abonti
aboundex
aboundexbot
acoon
acoonbot
acunetix
admantx
adscanner
afilias web mining tool
afiliaswebminingtool
ahrefsbot
aibot
aihitbot
aihitbot
aipbot
alexibot
alligator
allsubmitter
alphabot
ankit
apexoo
aqua_products
askpeterbot
aspiegel
aspseek
asterias
autoemailspider
awariorssbot
awariosmartbot
b2w/0.1
backdoorbot
backdoorbot/1.0
backlink-ceck
backlink-check
backlinkcrawler
backstreet
backweb
badass
bandit
barkrowler
batchftp
battleztar bazinga
bbbike
bdbrandprotect
bdcbot
bdfetch
berlin-fu-cow
betabot
bigfoot
birubot
bitacle
bixolabs
blackboard
black hole
blackwidow
blexbot
blow
blowfish
blowfish/1.0
boardreader
bolt
bookmark search tool
botalot
botonparade
botrighthere
bpimagewalker*
bpimagewalker
brandprotect
brandwatch
bubing
buddy
builtbottough
builtwith
bullseye
bullseye/1.0
bunnyslippers
burdaforward
buzzsumo
bytespider
calculon
careerbot
catchbot
catexplorador
cazoodlebot
ccbot
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
cheteam
chinaclaw
chlooe
clewwa-bot
clewwa-bot/nutch-1.0
claritybot
cliqzbot
cloud mapping
coccoc
coccocbot-web
cogentbot
cognitiveseo
collector
comodo ssl checker
comodosslchecker
comodo-certificates-spider
com.plumanalytics
content crawler
contentcrawler
copernic
copier
copyrightcheck
copyscape
cosmos
cosmos
craftbot
crawler4j
crawler.feedback
crawl.sogou.com
crazywebcrawler
crescent
crescent internet toolpak http ole control v.1.0
crunchbot
cshttp
curious
curl
custo
databasedrivermysqli
datacha0s
dblbot
dcpbot
demandbase-bot
demon
deusu
devil
digincore
digitalpebble
diibot
dirbuster
disco
discobot
discobot
disco pump 3.1
discoverybot
dispatch
dittospyder
domainappender
domaincrawler
domainsigmacrawler
domains project
domainsproject.org
domainstatsbot
dnyzbot
docomo/2.0
dotbot
dotbot
download ninja
download wonder
dragonfly
drip
drupact
dsearch
dts agent
easydl
ebingbong
ec2linkfinder
ecatch
eccp/1.0
ecxi
edisterbot
eirgrabber
emailcollector
emailsiphon
email siphon
emailwolf
email wolf
erocrawler
evc-batch
evil
exabot
exb language crawler
express webpictures
extlinksbot
extractor
extractorpro
extreme picture finder
eyenetie
ezooms
facebookscraper
fairad client
fast
fdm
femtosearchbot
fetch
fhscan
fimap
findlinks
flashget
flunky
foobot
freeuploader
frontpage
flaming attackbot
fyberspider
fyrebot
gaisbot
galaxybot
genieo
germcrawler
getintent
getright
getright/4.2
getweb
gigablast
gigabot
gigabot
g-i-g-a-b-o-t
go-ahead-got-it
gonzo
gotit
gozilla
go!zilla
grabber
grabnet
grafula
grapefx
grapeshotcrawler
gridbot
grub
grub-client
gslfbot
gt::www
haansoft
haosouspider
harvest
harvest/1.5
havij
headmasterseo
heritrix
hloader
hloader
hmview
htmlparser
httplib
http::lite
huaweisymantecspider
humanlinks
humanlinks
htdig
httrack
httrack 3.0
hybridbot
iblog
iccrawler - icjobs
icjobs
idbot
id-search
ilsebot
image fetch
image sucker
indeedbot
indy library
infonavirobot
infotekies
instabid
intelliseek
interget
internet ninja
internetseer
internetvista monitor
ips-agent
ipsagent
iria
irlbot
iron33/1.0.2
isitwp.com
iskanie
istellabot
it2media-domain-crawler
jamesbot
java
jbrofuzz
jennybot
jetcar
jetty
jikespider
jobboersebot
jobroboter
jobs.de-robot
joc web spider
joomla
jorgee
justview
jyxobot
kaloogabot
kenjin spider
keyword density
keyword density/0.9
kinza
kozmosbot
lanshanbot
larbin
larbin
lb-spider
leechftp
leechget
lex
lexibot
lftp
libweb
libweb/clshttp
libwhisker
libwww
libwww-perl
liebaofast
lightspeedsystems
likse
linguee
linguatools
linkdex.com
linkdexbot
linkextractorpro
linko
linkpadbot
linkscan/8.1a unix
linksmanager
linkwalker
linqiametadatadownloaderbot
linqiarssbot
linqiascrapebot
lipperhey
lipperhey spider
litefinder
litemage_walker
llc
lmspider
lnspiderguy
looksmart
lssrocketcrawler
ltx71
ltx71
ltx71 - (http://ltx71.com/)
lwp-request
lwp::simple
lwp-trivial
lwp-trivial/1.34
magnet
mag-net
magpie-crawler
mail.ru
mail.ru_bot
majestic12
majestic seo
majestic-seo
markmonitor
markwatch
masscan
mass downloader
mata hari
mauibot
mb2345browser
meanpathbot
meanpath bot
mediatoolkitbot
mediawords
megaindex.ru
memorybot
metauri
mfc_tear_sample
mia
miadev
micromessenger
microsoft data access
microsoft.url.control
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
midown tool
miixpc
miixpc/4.2
mister pix
mj12bot
mlbot
moget
moget/2.1
mojeek
mojeekbot
mojolicious
morfeus fucking scanner
mozilla/2.0 (compatible; ms frontpage 4.0)
mozilla/2.0 (compatible; ms frontpage 5.0)
mozilla/2.0 (compatible; ms frontpage x.0)
mozilla/4.0 (compatible; bullseye; windows 95)
mozilla/4.0 (compatible; msie 6.0; windows nt 5.1; sv1)
mozilla/4.0 (compatible; ms frontpage 6.0)
mozilla/4.0 (compatible; ms frontpage 12.0)
mozilla/4.0 (compatible; ms frontpage 14.0)
mozilla/4.0 (compatible; naverbot/1.0; http://help.naver.com/customer_webtxt_02.jsp)
mozilla/5.0 jorgee
mozilla/4.0 (compatible; t-h-u-n-d-e-r-s-t-o-n-e)
mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) gecko/2008032620
mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) gecko/
mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) gecko/
mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) gecko/
mozilla/5.0 (compatible; acoonbot/4.11.1; +http://www.acoon.de/robot.asp)
mozilla/5.0 (compatible; yeti/1.1; +http://naver.me/spd)
mozilla/5.0 (windows nt 6.1; wow64; rv:40.0) gecko/20100101 firefox/40.1
mozlila
mqqbrowser
mr.4x3
msfrontpage
msfrontpage/4.0
msfrontpage/5.0
msfrontpage/6.0
msfrontpage/12.0
msfrontpage/14.0
msfrontpage/15.0
msfrontpage/16.0
msiecrawler
msrabot
muhstik-scan
musobot
name intelligence
nameprotect
naver
naverbot-1.0
navroad
nearsite
needle
nerdbynature.bot
nessus
netants
netattache
netattache light 1.1
netcraft
netestatenecrawler
netestate ne crawler
netluchs
netlyzer
netmechanic
netspider
nettrack
net vampire
netvibes
netzip
nextgensearchbot
nibbler
nicerspro
niki-bot
nikto
nimblecrawler
nimbostratus
ninja
nmap
npbot
nutch
nutchboa
nutchboa/nutch-1.0-dev
nutchcvs
obot
octopus
offline explorer
offline navigator
oncrawl
oneriot
openacoon
openbot
openfind
openfind data gathere
openindexspider
openlinkprofiler
openvas
openvas
opidoobot
oppo a33
oracle ultra search
orangebot
orangespider
outclicksbot
outfoxbot
pageanalyzer
page analyzer
pagegrabber
pagepeeker
page scorer
pagescorer
pandalytics
panscient
papa foto
pavuk
pcbrowser
pecl::http
penthesilea
peoplepal
perman
petalbot
phpcrawl
picmole
picscout
picsearch
picturefinder
pimonster
pi-monster
pixray
pixray-seeker
pleasecrawl
plukkie
plumanalytics
pockey
poe-component-client-http
polaris version
probethenet
propowerbot
propowerbot/2.14
prowebwalker
psbot
psbot
pump
pxbroker
pycurl
python-urllib
qualidator*
quepasacreep
queryn metasearch
quick-crawler
radiation retriever 1.1
rankactive
rankactivelinkbot
rankflex
rankingbot
rankingbot2
rankivabot
rankurbot
realdownload
reaper
rebelmouse
recorder
redesscrapy
reget
repomonkey
repomonkey bait & tackle/v1.01
reverseget
ripper
rma
rocketcrawler
rogerbot
ruby
s1z.ru
salesintelligent
satoristudio.net
schrein
sbider
scanalert
scanbot
scan.lol
scooperbot
scooter
scoutjet
scrapy
screaming
screaming frog seo spider
screenerbot
search17
searchestate
searchmetricsbot
searchpreview
semrushbot
semrushbot-ba
semrushbot-bm
semrushbot-ct
semrushbot-sa
semrushbot-si
semrushbot-swa
seokicks
seokicks-robot
seolyticscrawler
seomoz
seoprofiler
seoscanners
seoscanners.net
seoscanners.net/1
seositecheckup
seostats
serpstatbot
sexsearcher
seznambot
shodan
siphon
sistrix
sistrix crawler
sitebeam
sitecheckerbotcrawler
sitechecker.pro
sitecheck.internetseer.com
siteexplorer
siteimprove
sitelockspider
sitesnagger
sitesucker
site sucker
sitevigil
slysearch
smartdownload
smtbot
snake
snapbot
snoopy
socialrankiobot
sociscraper
sogouspider
sogou web spider
solomonobot
solomonolinkchecker
sosospider
sosospider
sottopop
spacebison
spammen
spankbot
spanner
spanner
sp_auditbot
spbot
speedy
spiderling
spiderlytics
spinn3r
sputnikbot
spyfu
sqlmap
sqlworm
sqworm
steeler
stripper
sucker
sucuri
suggybot
superbot
superbot/2.6
superhttp
surfbot
surveybot
suzuran
suzuran
swebot
swiftbot
sysscan
szukacz
szukacz/1.4
t0phackteam
t8abot
takeout
teleport
teleportpro
telesoft
telesphoreo
telesphorep
tineye
thenomad
thumbor
thunderstone
the intraformant
tighttwatbot
titan
toata
tocrawl/urldispatcher
toweyabot
tracemyfile
trendiction
trendictionbot
trendiction.com
trendiction.de
turingos
turingos
turnitin
turnitinbot
turnitinbot/1.5
true_robot
true_robot/1.0
trendictionbot
twengabot
twenga2.com
twenga.com
twice
typhoeus
unisterbot
unister
unister*
unwindfetchor
updownerbot
upflow
url control
url_spider_pro
urly warning
urly.warning
vacuum
vagabondo
vb project
vci
vci webviewer vci webviewer win32
vebidoobot
vericitecrawler
vidiblescraper
virusdie
voideye
voil
voltron
voltron
wallpapers/3.0
wallpapershd
wasalive-bot
wbsearchbot
webalta
webauto
web auto
webbandit
webbandit/3.50
webdav
webcapture 2.0
webcollage
web collage
webcopier
webcopier v.2.2
webcopier v3.2a
webcopy
webenhancer
web enhancer
webfetch
web fetch
webfuck
web fuck
webgo is
webimagecollector
web image collector
webinator
webleacher
webmastercoffee
webmasterworldforumbot
webmeup-crawler
webmirror
webofantbot
webpix
web pix
webreaper
websauger
web sauger
webshag
websiteextractor
website extractor
websitequester
website quester
webster
webster pro
webstripper
webstripper/2.02
websucker
web sucker
webwhacker
webzip
webzip/4.0
webzip/4.21
webzip/5.0
wesee
wget
wget
wget/1.5.3
wget/1.6
whack
whacker
whatweb
who.is bot
widow
winhttrack
wiseguys robot
wisenutbot
wonderbot
wotbox
wotbox
wprecon
wpscan
www-collector-e
www-mechanize
www::mechanize
wwwoffle
x09mozilla
x22mozilla
x28-job-bot
xaldon webspider
xaldon_webspider
xenu
xenu's
xenu's link sleuth 1.1c
xovi
xovibot
xpymep1.exe
yacybot
yeti
yeti/1.0 (+http://help.naver.com/robots/)
yeti/1.0 (nhn corp.; http://help.naver.com/robots/)
yeti-mobile
youdaobot
zade
zauba
zauba.io
zealbot
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
zgrab
zitebot
zmeu
zookabot
zumbot
zyborg

Rule Path
Disallow /

yandex
slurp
bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://ijaminecraft.com/sitemap.xml

Comments

  • Copyright by ijaminecraft.com - All rights reserved.

Warnings

  • 6 invalid lines.