Log In Sign Up

preiswertepc.de
robots.txt

Robots Exclusion Standard data for preiswertepc.de

Resource Scan

Scan Details

Site Domain preiswertepc.de
Base Domain preiswertepc.de
Scan Status Ok
Last Scan2024-10-25T10:56:30+00:00
Next Scan 2024-11-24T10:56:30+00:00

Last Scan

Scanned2024-10-25T10:56:30+00:00
URL https://preiswertepc.de/robots.txt
Domain IPs 78.138.119.184
Response IP 78.138.119.184
Found Yes
Hash c6c4a527a35fe95c7af4d7308378d5e1a3933cacca0fb14801be3d279a972e55
SimHash 5e9acb505443

Groups

acoon

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

openacoon

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

birubot

Rule Path
Disallow /

bixolabs

Rule Path
Disallow /

botonparade

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

unwindfetchor

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

iccrawler - icjobs

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

oneriot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

ruby

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

search17

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

spbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

shopwikidisallow: /
turnitinbot

Rule Path
Disallow /

twenga2.com

Rule Path
Disallow /

twenga.com

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

zookabot

Rule Path
Disallow /
Back to top

Comments

  • ACHTUNG!!!
  • An dieser Datei KEINE Aenderungen vornehmen!!!
  • Dies ist eine automatisch erstellte Datei!
  • Aenderungen werden ohne Sicherung automatisch
  • ueberschrieben!
  • -------------------------------------------------
  • Version: 2012-05-07 09:55
  • Generiert: 07.05.2012 09:55
  • durch Script: esRemoteAccessSettings.class.php
  • -------------------------------------------------
  • 80legs (http://www.80legs.com/webcrawler.html)
  • AcoonBot (http://www.acoon.de/robot.asp)
  • Petal Search
  • Ahrefs.com (http://ahrefs.com/robot/)
  • alexa.com (http://www.alexa.com/site/help/webmasters)
  • BacklinkCrawler (http://www.backlinktest.com/crawler.html)
  • Baiduspider (http://www.baidu.com/search/spider.htm)
  • Birubot [Bot]
  • Bixo Labs (http://bixolabs.com)
  • BotOnParade (www.bots-on-para.de/bot.html)
  • CareerBot (http://www.career-x.de/bot.html)
  • discobot (http://discoveryengine.com/discobot.html)
  • Exabot/3.0 (http://www.exabot.com/go/robot)
  • Gigabot (http://www.gigablast.com/spider.html)
  • Gnip [Bot] (http://www.gnip.com)
  • Huawei Symantec (http://www.huaweisymantec.com/en/IRL/spider/)
  • iCjobs Stellenangebote Jobs (www.icjobs.de/bot.htm)
  • Majestic-12 (http://www.majestic12.co.uk/bot.php)
  • MojeekBot/0.2 (http://www.mojeek.com/bot.html)
  • NerdByNature (http://www.nerdbynature.net/bot)
  • oBot/2.3.1 (http://filterdb.iss.net/crawler/)
  • OneRiot [Bot] (http://www.oneriot.com)
  • Plukkie (http://www.botje.com/plukkie.htm)
  • Ruby
  • ScoutJet (http://www.scoutjet.com/)
  • Search17Bot (http://www.search17.com/bot.php)
  • SEOkicks-Robot (http://www.seokicks.de/robot.html)
  • seoprofiler (http://www.seoprofiler.com/bot)
  • Sosospider (http://help.soso.com/webspider.htm)
  • spbot/seoprofiler.com (http://www.seoprofiler.com/bot)
  • Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
  • Spinn3r (http://spinn3r.com/robot)
  • The ShopWiki Crawler (http://www.shopwiki.com/wiki/Help:Bot)
  • TurnitinBot (http://www.turnitin.com/robot/crawlerinfo.html)
  • TwengaBot (http://www.twenga.com/bot.html)
  • WBSearchBot (http://www.warebay.com/bot.html)
  • Yandex (http://yandex.com/bots)
  • Zookabot (http://zookabot.com)
  • Erweiterungen des Shopbetreibers
Back to top

Warnings

  • 2 invalid lines.
Back to top