kochen-und-design.de
robots.txt

Robots Exclusion Standard data for kochen-und-design.de

Resource Scan

Scan Details

Site Domain kochen-und-design.de
Base Domain kochen-und-design.de
Scan Status Ok
Last Scan2024-10-04T01:17:25+00:00
Next Scan 2024-10-11T01:17:25+00:00

Last Scan

Scanned2024-10-04T01:17:25+00:00
URL https://kochen-und-design.de/robots.txt
Domain IPs 2001:8d8:100f:f000::200, 217.160.0.38
Response IP 217.160.0.38
Found Yes
Hash a1edefc06fe764c9f3891318f7f2276f8f72f991cabd73987ea6e66c905b38fc
SimHash 883c03716cdb

Groups

*
googlebot

Rule Path
Allow *.js
Allow *.css
Disallow /cgi-bin/
Disallow /dbadmin/
Disallow /PEAR/
Disallow /phpMyAdmin-3.3.10-all-languages/
Disallow /zhl/

seokicks
seokicks-robot
majesticseo
backlinkcrawler
xovi
xovibot
mj12bot
spbot
searchmetricsbot
search17
ahrefsbot
ia_archiver
turnitinbot
slysearch
findlinks
magpie-crawler
pixray-seeker
ezooms
lb-spider
wbsearchbot
psbot
huaweisymantecspider
ec2linkfinder
htdig
semrushbot
discobot
linkdex.com
seznambot
edisterbot
swebot
picmole
yeti
yeti-mobile
pagepeeker
catchbot
yacybot
netestatenecrawler
surveybot
comodosslchecker
comodo-certificates-spider
gonzo
schrein
afiliaswebminingtool
suggybot
bdbrandprotect
bpimagewalker
updownerbot
lex
contentcrawler
dcpbot
kaloogabot
mlbot
icjobs
obot
webmastercoffee
qualidator
webinator
scooter
thunderstone
opidoobot
ips-agent
tineye
unisterbot
unister
reverseget
dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.kochen-und-design.de/sitemap.xml

Comments

  • robots.txt zu https://www.kochen-und-design.de/ etc.

Warnings

  • 1 invalid line.