deliciaskitchen.com
robots.txt

Groups

*

semrushbot disallow: /
twiceler disallow: /
gigabot disallow: /
scrubby disallow: /
robozilla disallow: /
nutch disallow: /
ia_archiver disallow: /
baiduspider disallow: /
naverbot disallow: /
yeti disallow: /
psbot disallow: /
asterias disallow: /
yahoo-blogs/v3.9 disallow: /
ahrefsbot disallow: /
ezooms disallow: /
mj12bot disallow: /
yandexbot disallow: /
ia_archiver disallow: /
duggmirror disallow: /
addthis.com disallow: /
admantx disallow: /
ahrefsbot disallow: /
bdcbot disallow: /
bender disallow: /
bixocrawler disallow: /
bl.uk_lddc_bot disallow: /
blexbot disallow: /
bubing disallow: /
cliqzbot disallow: /
cncdialer disallow: /
crawler4j disallow: /
crystalsemanticsbot disallow: /
cyberalert disallow: /
digext disallow: /
discobot disallow: /
discoverybot disallow: /
dloader disallow: /
dloader(naverrobot) disallow: /
doc disallow: /
dotbot disallow: /
download ninja disallow: /
dts agent disallow: /
exabot disallow: /
ezooms disallow: /
fairshare disallow: /
fetch disallow: /
flamingo_searchengine disallow: /
genieo disallow: /
gigabot disallow: /
grub-client disallow: /
heritrix disallow: /
heritrix/3.3.0 disallow: /
httrack disallow: /
ia_archiver disallow: /
integromedb disallow: /
istellabot disallow: /
jikespider disallow: /
jyxobot disallow: /
k2spider disallow: /
kimengi disallow: /
kimengi/nineconnections.com disallow: /
larbin disallow: /
lexxebot/1.0 disallow: /
libwww disallow: /
linko disallow: /
livelapbot disallow: /
magpie-crawler disallow: /
maxthon disallow: /
metauri disallow: /
microsoft.url.control disallow: /
mj12bot disallow: /
moreover disallow: /
moreoverbot disallow: /
msiecrawler disallow: /
nabot disallow: /
naverbot disallow: /
nerdbynature.bot disallow: /
netestate ne crawler disallow: /
netseer crawler disallow: /
newscan disallow: /
nextgensearchbot disallow: /
npbot disallow: /
nutch disallow: /
offline explorer disallow: /
omgilibot disallow: /
orthogaffe disallow: /
piplbot disallow: /
pixray-seeker disallow: /
proximic disallow: /
psbot disallow: /
queryseekerspider disallow: /
rogerbot disallow: /
seokicks disallow: /
seokicks-robot disallow: /
sitebot disallow: /
sitebot/0.1 disallow: /
sitecheck.internetseer.com disallow: /
sitesnagger disallow: /
slurp disallow: /
sogou disallow: /
sosospider disallow: /
spbot disallow: /
spinn3r disallow: /
teleport disallow: /
teleportpro disallow: /
trendictionbot disallow: /
trovitbot disallow: /
turnitinbot disallow: /
ubicrawler disallow: /
umbot-ln disallow: /
unisterbot disallow: /
universalfeedparser disallow: /
wbsearchbot disallow: /
webcopier disallow: /
webreaper disallow: /
webstripper disallow: /
webzip disallow: /
wesee:search disallow: /
wget disallow: /
wotbot disallow: /
wotbox disallow: /
xenu disallow: /
yasni disallow: /
zao disallow: /
zealbot disallow: /
zyborg disallow: /
aqua_products disallow: /
asterias disallow: /
b2w/0.1 disallow: /
backdoorbot/1.0 disallow: /
black hole disallow: /
blowfish/1.0 disallow: /
bookmark search tool disallow: /
botalot disallow: /
builtbottough disallow: /
bullseye/1.0 disallow: /
bunnyslippers disallow: /
cegbfeieh disallow: /
cheesebot disallow: /
cherrypicker disallow: /
cherrypicker /1.0 disallow: /
cherrypickerelite/1.0 disallow: /
cherrypickerse/1.0 disallow: /
copyrightcheck disallow: /
cosmos disallow: /
crescent disallow: /
crescent internet toolpak http ole control v.1.0 disallow: /
dittospyder disallow: /
emailcollector disallow: /
emailsiphon disallow: /
emailwolf disallow: /
erocrawler disallow: /
extractorpro disallow: /
fairad client disallow: /
flaming attackbot disallow: /
foobot disallow: /
gaisbot disallow: /
getright/4.2 disallow: /
grub disallow: /
grub-client disallow: /
harvest/1.5 disallow: /
hloader disallow: /
httplib disallow: /
humanlinks disallow: /
ia_archiver disallow: /
ia_archiver/1.6 disallow: /
infonavirobot disallow: /
iron33/1.0.2 disallow: /
jennybot disallow: /
kenjin spider disallow: /
keyword density/0.9 disallow: /
larbin disallow: /
lexibot disallow: /
libweb/clshttp disallow: /
linkextractorpro disallow: /
linkscan/8.1a unix disallow: /
linkwalker disallow: /
lnspiderguy disallow: /
lwp-trivial disallow: /
lwp-trivial/1.34 disallow: /
mata hari disallow: /
microsoft url control disallow: /
microsoft url control - 5.01.4511 disallow: /
microsoft url control - 6.00.8169 disallow: /
miixpc disallow: /
miixpc/4.2 disallow: /
mister pix disallow: /
moget disallow: /
moget/2.1 disallow: /
mozilla/4 disallow: /
mozilla/4.0 (compatible; bullseye; windows 95) disallow: /
mozilla/4.0 (compatible; msie 4.0; windows 2000) disallow: /
mozilla/4.0 (compatible; msie 4.0; windows 95) disallow: /
mozilla/4.0 (compatible; msie 4.0; windows 98) disallow: /
mozilla/4.0 (compatible; msie 4.0; windows me) disallow: /
mozilla/4.0 (compatible; msie 4.0; windows nt) disallow: /
mozilla/4.0 (compatible; msie 4.0; windows xp) disallow: /
mozilla/5 disallow: /
msiecrawler disallow: /
netants disallow: /
netmechanic disallow: /
nicerspro disallow: /
offline explorer disallow: /
openbot disallow: /
openfind disallow: /
openfind data gathere disallow: /
oracle ultra search disallow: /
perman disallow: /
propowerbot/2.14 disallow: /
prowebwalker disallow: /
psbot disallow: /
python-urllib disallow: /
queryn metasearch disallow: /
radiation retriever 1.1 disallow: /
repomonkey disallow: /
repomonkey bait & tackle/v1.01 disallow: /
rma disallow: /
searchpreview disallow: /
sitesnagger disallow: /
spankbot disallow: /
spanner disallow: /
suzuran disallow: /
szukacz/1.4 disallow: /
teleport disallow: /
teleportpro disallow: /
telesoft disallow: /
the intraformant disallow: /
thenomad disallow: /
tighttwatbot disallow: /
titan disallow: /
tocrawl/urldispatcher disallow: /
true_robot disallow: /
true_robot/1.0 disallow: /
turingos disallow: /
url control disallow: /
url_spider_pro disallow: /
urly warning disallow: /
vci disallow: /
vci webviewer vci webviewer win32 disallow: /
web image collector disallow: /
webauto disallow: /
webbandit disallow: /
webbandit/3.50 disallow: /
webcopier disallow: /
webenhancer disallow: /
webmasterworldforumbot disallow: /
websauger disallow: /
website quester disallow: /
webster pro disallow: /
webstripper disallow: /
webzip disallow: /
webzip/4.0 disallow: /
wget disallow: /
wget/1.5.3 disallow: /
wget/1.6 disallow: /
www-collector-e disallow: /
xenu's disallow: /
xenu's link sleuth 1.1c disallow: /
zeus disallow: /
zeus 32297 webster pro v2.9 win32 disallow: /

No rules defined. All paths allowed.

Other Records

Comments

• Bloqueo basico para todos los bots y crawlers
• puede dar problemas por bloqueo de recursos en GWT
• Bloqueo de busquedas
• Bloqueo de trackbacks
• Impedir URLs terminadas en /trackback/ que sirven como Trackback URL.
• Lista permitidos
• Bloqueo de feeds para crawlers
• Robots de programas
• Bots bloqueados
• 135 robots to keep away
• END 135 robots to keep away
• En condiciones normales este es el sitemap
• Sitemap: https://deliciaskitchen.com/sitemap.xml
• Si utilizas Yoast SEO estos son los sitemaps principales
• Sitemap: https://deliciaskitchen.com/sitemap_index.xml

Warnings

• 2 invalid lines.