technologieland-hessen.de
robots.txt
Robots Exclusion Standard data for technologieland-hessen.de
Resource Scan
Scan Details
| Site Domain | technologieland-hessen.de |
| Base Domain | technologieland-hessen.de |
| Scan Status | Ok |
| Last Scan | 2024-09-20T17:14:17+00:00 |
| Next Scan | 2024-10-20T17:14:17+00:00 |
Last Scan
| Scanned | 2024-09-20T17:14:17+00:00 |
| URL | https://technologieland-hessen.de/robots.txt |
| Redirect | https://www.technologieland-hessen.de/robots.txt |
| Redirect Domain | www.technologieland-hessen.de |
| Redirect Base | technologieland-hessen.de |
| Domain IPs | 213.216.14.170 |
| Redirect IPs | 213.216.17.161 |
| Response IP | 213.216.17.161 |
| Found | Yes |
| Hash | b4331e2ed3d019a554855abd1336658c5931c7bfc35a2b0069bb5c5a90ddc917 |
| SimHash | 933a924e6533 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dynasite.cfm?dsmid=511706 |
| Disallow | /dynasite.cfm?dsmid=511879 |
| Disallow | /RePowerEU |
| Disallow | /dynasite.cfm?dsmid=517958 |
| Disallow | /dynasite.cfm?dsmid=518013 |
| Disallow | /dynasite.cfm?dsmid=518092 |
| Disallow | /INNOVATIONlinks |
| Disallow | /recordings-wbe |
| Disallow | /recordings-coronaviren-im-abwasser |
| Disallow | /aufzeichnungen-wbe |
| Disallow | /dynasite.cfm?dsmid=516157 |
| Disallow | /InnovationLinksTech-Anmeldung |
| Disallow | /innovationlinks2020 |
| Disallow | /partneringPlus |
| Disallow | /clustertagung2018 |
| Disallow | /clustertagung2019 |
| Disallow | /clustertagung2020 |
| Disallow | /clustertagung-2021 |
| Disallow | /cluster-meets-tlh-2021 |
| Disallow | /strategie-green-food |
| Disallow | /interne-vernetzung-2021 |
| Disallow | /bioinnovationen-rueckblick-ws9 |
| Disallow | /Intelligent-vernetzt |
| Disallow | /intelligent-Vernetzt-Rueckblick |
| Disallow | /Hik2Partnering |
| Disallow | /materialformtprodukt |
| Disallow | /dynasite.cfm?dsmid=517315 |
| Disallow | /dynasite.cfm?dsmid=517199 |
| Disallow | /M4EGD_Industrie_220421__Folien |
| Disallow | /dynasite.cfm?dsmid=517258 |
| Disallow | /m4egd-Videos |
| Disallow | /dynasite.cfm?dsmid=516579 |
| Disallow | /m4egd_Folien210611 |
| Disallow | /dynasite.cfm?dsmid=517309 |
| Disallow | /dynasite.cfm?dsmid=517644 |
| Disallow | /dynasite.cfm?dsmid=517668 |
| Disallow | /dynasite.cfm?dsmid=516469 |
| Disallow | /kooperation |
| Disallow | /magazin |
| Disallow | /film |
| Disallow | /e-film |
| Disallow | /digi-kom-kit |
| Disallow | /hessen-coaching |
| Disallow | /dynasite.cfm?dsmid=517259 |
| Disallow | /dynasite.cfm?dsmid=517260 |
| Disallow | /dynasite.cfm?dsmid=517261 |
| Disallow | /dynasite.cfm?dsmid=517262 |
| Disallow | /dynasite.cfm?dsmid=517263 |
| Disallow | /dynasite.cfm?dsmid=517286 |
| Disallow | /dynasite.cfm?dsmid=517287 |
| Disallow | /dynasite.cfm?dsmid=517288 |
| Disallow | /dynasite.cfm?dsmid=517289 |
| Disallow | /dynasite.cfm?dsmid=517291 |
| Disallow | /dynasite.cfm?dsmid=517292 |
| Disallow | /dynasite.cfm?dsmid=517295 |
| Disallow | /dynasite.cfm?dsmid=517296 |
| Disallow | /dynasite.cfm?dsmid=517297 |
| Disallow | /dynasite.cfm?dsmid=517298 |
| Disallow | /dynasite.cfm?dsmid=517302 |
| Disallow | /dynasite.cfm?dsmid=517303 |
| Disallow | /DIGI-Zuschuss-Quali |
| Disallow | /efre |
| Disallow | /clusterfilme |
| Disallow | /dynasite.cfm?dsmid=517246 |
| Disallow | /InnovationGAME |
| Disallow | /testseiten |
| Disallow | /clusterfoerderung |
| Disallow | /test |
| Disallow | /sd |
| Disallow | /wwh2 |
| Disallow | /WWH1 |
| Disallow | /test-digi |
| Disallow | /digi-impuls-test |
| Disallow | /digi-beratung-test |
| Disallow | /digi-zuschuss-test |
| Disallow | /dynasite.cfm?dsmid=516809 |
| Disallow | /praxisbeispiele |
| Disallow | /dynasite.cfm?dsmid=516377 |
| Disallow | /s1 |
| Disallow | /s2 |
| Disallow | /test-verteiler-seite |
| Disallow | /test-innovationsfeldseite |
| Disallow | /test-inhaltsseite |
| Disallow | /vara-tool |
| Disallow | /dynasite.cfm?dsmid=516613 |
| Disallow | /2021 |
| Disallow | /hausmesse-2021 |
| Disallow | /test-start |
| Disallow | |
| Disallow | /test-elemente |
| Disallow | /cd-manual |
| Disallow | /marketing |
| Disallow | /dynasite.cfm?dsmid=512627 |
| Disallow | /dynasite.cfm?dsmid=517185 |
| Disallow | /dynasite.cfm?dsmid=517173 |
| Disallow | /beratung-themen |
| Disallow | /een |
| Disallow | /hessen-pius2 |
| Disallow | /hmp |
| Disallow | /rkw |
| Disallow | /weitere-beratungsangebote |
| Disallow | /wibank |
| Disallow | /bionik |
| Disallow | /breitband |
| Disallow | /cc-cena |
| Disallow | /clusterflyer |
| Disallow | /digitales-hessen |
| Disallow | /foerderung |
| Disallow | /hessen-pius1 |
| Disallow | /nicht-monetaere-foerderung |
| Disallow | /fznum |
| Disallow | /hessen-pius |
| Disallow | /kompetenzfelder |
| Disallow | /material-nanotechnologien |
| Disallow | /mikrosystemtechnik |
| Disallow | /optik-photonik |
| Disallow | /produktion |
| Disallow | /schaufenster |
| Disallow | /services |
| Disallow | /themen |
| Disallow | /ressourceneffizienz |
| Disallow | /umwelt-export |
blp_bbot/0.1
grub-client
grub
looksmart
webzip
larbin
b2w/0.1
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
teleport
teleportpro
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
mozilla/4.0 (compatible; bullseye; windows 95)
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
webmasterworldforumbot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
gonzo1
gonzo2
gonzo1p
gonzo2p
twiceler
botonparade
acontbot
askpeter_bot
askpeter_jeanie
boitho.com-dc
charlotte
cityreview
daumoa
emailsearch
envolk
exabot-thumbnails
exabot
gigabot
gonzo*
grubng
holmes
gt::www
httrack
iearthworm/1.0
isidorus
jakarta commons-httpclient
java/1.6.0_10
jobs.de-robot
mj12bot
mail.ru
moosebot
naverbot
openx spider
panscient.com
privacyfinder
proximic
psbot
rexyobot 1.11
seekbot
shopwiki
sosospider
speedy
stackrambler
surveybot
tasapspider
touche
voilabot
yandex
yanga worldsearch bot
yeti
youdaobot
dotbot
eurobot/1.0
baiduspider
iccrawler - icjobs
getright/4.2
wbsearchbot
pixray-seeker
seokicks
seokicks-robot
sistrix
majesticseo
backlinkcrawler
xovi
xovibot
mj12bot
spbot
searchmetricsbot
search17
ahrefsbot
ia_archiver
turnitinbot
slysearch
findlinks
magpie-crawler
pixray-seeker
ezooms
lb-spider
wbsearchbot
psbot
huaweisymantecspider
ec2linkfinder
htdig
semrushbot
discobot
linkdex.com
seznambot
edisterbot
swebot
picmole
yeti
yeti-mobile
pagepeeker
catchbot
yacybot
netestatenecrawler
surveybot
comodosslchecker
comodo-certificates-spider
gonzo
schrein
afiliaswebminingtool
suggybot
bdbrandprotect
bpimagewalker
updownerbot
lex
contentcrawler
dcpbot
kaloogabot
mlbot
icjobs
obot
webmastercoffee
qualidator
webinator
scooter
thunderstone
larbin
opidoobot
ips-agent
tineye
unisterbot
unister
reverseget
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /logs/ |
| Disallow | /backend/ |
| Disallow | /data/ |
| Disallow | /newsX/ |
| Disallow | /entwicklung/ |
| Disallow | /publikationenX/ |
| Disallow | /include/ |
| Disallow | /includes/ |
| Disallow | /mailsuite/ |
| Disallow | /editor/ |
| Disallow | /_include/ |
| Disallow | /_includes/ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /dsglobal/ |
*
| Rule | Path |
|---|---|
| Allow | /mm/ |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.technologieland-hessen.de/sitemap9063.xml |
Warnings
- 1 invalid line.