Log In Sign Up

taufgeschenke.com
robots.txt

Robots Exclusion Standard data for taufgeschenke.com

Resource Scan

Scan Details

Site Domain taufgeschenke.com
Base Domain taufgeschenke.com
Scan Status Ok
Last Scan2026-02-07T09:22:40+00:00
Next Scan 2026-02-14T09:22:40+00:00

Last Scan

Scanned2026-02-07T09:22:40+00:00
URL https://taufgeschenke.com/robots.txt
Domain IPs 85.13.138.57
Response IP 85.13.138.57
Found Yes
Hash 831e136909332f5316876d230ed54761af1a10157d7a86de6d9957e3045325aa
SimHash 930b7b71a96f

Groups

ia_archiver

Rule Path
Disallow /

search.inacts.com

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

black.hole

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

blowfish

Rule Path
Disallow /

botalot

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bullseye

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

cegbfeieh

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

crescent

Rule Path
Disallow /

custo

Rule Path
Disallow /

disco

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

download\

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

express\

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

flashget

Rule Path
Disallow /

foobot

Rule Path
Disallow /

frontpage

Rule Path
Disallow /

getright

Rule Path
Disallow /

getweb!

Rule Path
Disallow /

go-ahead-got-it

Rule Path
Disallow /

go!zilla

Rule Path
Disallow /

grabnet

Rule Path
Disallow /

grafula

Rule Path
Disallow /

harvest

Rule Path
Disallow /

hloader

Rule Path
Disallow /

hmview

Rule Path
Disallow /

httplib

Rule Path
Disallow /

httrack

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

image\

Rule Path
Disallow /

indy\

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

interget

Rule Path
Disallow /

internet\

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

joc\

Rule Path
Disallow /

kenjin.spider

Rule Path
Disallow /

keyword.density

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

libweb/clshttp

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkscan/8.1a.unix

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

mass\

Rule Path
Disallow /

mata.hari

Rule Path
Disallow /

microsoft.url

Rule Path
Disallow /

midown\

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

mister.pix

Rule Path
Disallow /

mister\

Rule Path
Disallow /

moget

Rule Path
Disallow /
Disallow /

navroad

Rule Path
Disallow /

nearsite

Rule Path
Disallow /

netants

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

netspider

Rule Path
Disallow /

net\

Rule Path
Disallow /

netzip

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

npbot

Rule Path
Disallow /

octopus

Rule Path
Disallow /

offline.explorer

Rule Path
Disallow /

openfind

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

papa\

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

propowerbot/2.14

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

queryn.metasearch

Rule Path
Disallow /

reget

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

rma

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

the.intraformant

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

titan

Rule Path
Disallow /

tjvmultihttpgrabber component

Rule Path
Disallow /

tocrawl/urldispatcher

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

turingos

Rule Path
Disallow /

turnitinbot/1.5

Rule Path
Disallow /

urly.warning

Rule Path
Disallow /

vci

Rule Path
Disallow /

voideye

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webemailextrac.*

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webgo\

Rule Path
Disallow /

web.image.collector

Rule Path
Disallow /

webleacher

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

website.quester

Rule Path
Disallow /

webster.pro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

widow

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

wwwoffle

Rule Path
Disallow /

xaldon\

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /
Back to top

Warnings

  • 3 invalid lines.
Back to top