Log In Sign Up

bankingcheck.de
robots.txt

Robots Exclusion Standard data for bankingcheck.de

Resource Scan

Scan Details

Site Domain bankingcheck.de
Base Domain bankingcheck.de
Scan Status Ok
Last Scan2024-10-24T18:27:59+00:00
Next Scan 2024-11-23T18:27:59+00:00

Last Scan

Scanned2024-10-24T18:27:59+00:00
URL https://bankingcheck.de/robots.txt
Redirect https://www.bankingcheck.de/robots.txt
Redirect Domain www.bankingcheck.de
Redirect Base bankingcheck.de
Domain IPs 138.201.4.202
Redirect IPs 138.201.4.202
Response IP 138.201.4.202
Found Yes
Hash 87223076e0e84b7d2c9d71f1c78a305e5cc17b136e3942523827068380d5dd8a
SimHash 3834151a4678

Groups

rogerbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow *

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

htdig

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

picmole

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

comodosslchecker

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

schrein

Rule Path
Disallow /

afiliaswebminingtool

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

lex

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

obot

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

qualidator

Rule Path
Disallow /

webinator

Rule Path
Disallow /

scooter

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

larbin

Rule Path
Disallow /

opidoobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unister

Rule Path
Disallow /

reverseget

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

java

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

nutch

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

xxx

Rule Path
Disallow /

pingdom

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

phantom

Rule Path
Disallow /

facebook

Rule Path
Disallow /

ning

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

*

Rule Path
Disallow /banken/ethical-finance-center

*

Rule Path
Disallow /banken/bewertungen/615546/ethical-finance-center

*

Rule Path
Disallow /banken/ethical-finance-center?kommentare

*

Rule Path
Allow /includes/
Allow /misc/
Allow /modules/
Allow /profiles/
Allow /scripts/
Allow /themes/
Allow /modules/node/node.css*
Allow /modules/poll/poll.css*
Allow /modules/system/defaults.css*
Allow /modules/system/system.css*
Allow /modules/system/system-menus.css*
Allow /modules/user/user.css*
Allow /modules/forum/forum.css*
Allow /themes/pixture_reloaded/layout.css*
Allow /themes/pixture_reloaded/custom.css*
Allow /themes/pixture_reloaded/sf/css/superfish.css*
Allow /themes/pixture_reloaded/socialshareprivacy/socialshareprivacy.css*
Allow /themes/pixture_reloaded/lib/jquery-1.8.1.js
Allow /misc/jquery.js*
Allow /misc/drupal.js*
Allow /themes/pixture_reloaded/sf/js/superfish.js*
Allow /themes/pixture_reloaded/jquery.simplemodal.1.4.2.min.js*
Allow /themes/pixture_reloaded/jquery.socialshareprivacy.js*
Allow /themes/pixture_reloaded/lib/functions.js*
Allow /themes/pixture_reloaded/lib/boxover.js*
Allow /themes/pixture_reloaded/lib/ga_script.js*
Allow /themes/pixture_reloaded/lib/modal_login.js*
Allow /themes/pixture_reloaded/socialshareprivacy/socialshareprivacyLoader.js*
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Allow /themes/pixture_reloaded/images/*
Disallow /admin/
Disallow /comment/reply/
Disallow /logout/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Back to top

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • kickout bots
  • aus dem Index entfernen
  • everything else
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
Back to top

Warnings

  • 4 invalid lines.
Back to top