Log In Sign Up

handgefertigtes.de
robots.txt

Robots Exclusion Standard data for handgefertigtes.de

Resource Scan

Scan Details

Site Domain handgefertigtes.de
Base Domain handgefertigtes.de
Scan Status Ok
Last Scan2024-09-12T00:30:34+00:00
Next Scan 2024-10-12T00:30:34+00:00

Last Scan

Scanned2024-09-12T00:30:34+00:00
URL https://www.handgefertigtes.de/robots.txt
Domain IPs 54.194.165.111
Response IP 54.194.165.111
Found Yes
Hash 23dc66ce5c24d5c7c48080bf7d1d8e34900dfe4ce1e8f311989695c60f1bed74
SimHash e105f051e3aa

Groups

*

Rule Path
Disallow
Disallow /catalog/product_compare/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /customize/
Disallow /newsletter/
Disallow /onestepcheckout/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /catalog/product/gallery/
Disallow /index.php/
Disallow /agb/
Disallow /widerruf/
Disallow /versand/
Disallow /datenschutzerklaerung/
Disallow /impressum/
Disallow /*?
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /mage
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /CVS
Disallow /*.git$
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /php*
Disallow /*.php
Disallow /*?p=*
Disallow /*?SID=

adsbot-google

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.2

spbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

yandex

Rule Path
Disallow /

proximic

Rule Path
Disallow /

slurp

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

acapbot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

attackbot

Rule Path
Disallow /

backdorbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

binlar

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blowfish

Rule Path
Disallow /

bullseye

Rule Path
Disallow /

bunnys

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

casper

Rule Path
Disallow /

checkpriv

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypick

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

choppy

Rule Path
Disallow /

clshttp

Rule Path
Disallow /

cmsworld

Rule Path
Disallow /

copernic

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

crescent

Rule Path
Disallow /

cy_cho

Rule Path
Disallow /

datacha

Rule Path
Disallow /

diavol

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

dotnetdotcom

Rule Path
Disallow /

dumbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extract

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

feedfinder

Rule Path
Disallow /

flaming

Rule Path
Disallow /

flashget

Rule Path
Disallow /

flicky

Rule Path
Disallow /

foobot

Rule Path
Disallow /

g00g1e

Rule Path
Disallow /

getright

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

go-ahead-got

Rule Path
Disallow /

gozilla

Rule Path
Disallow /

grabnet

Rule Path
Disallow /

grafula

Rule Path
Disallow /

harvest

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

httrack

Rule Path
Disallow /

icarus6j

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

kmccrew

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

libweb

Rule Path
Disallow /

linkextractor

Rule Path
Disallow /

linkscan

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

loader

Rule Path
Disallow /

masscan

Rule Path
Disallow /

miner

Rule Path
Disallow /

mechanize

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

morfeus

Rule Path
Disallow /

moveoverbot

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

netspider

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

nikto

Rule Path
Disallow /

ninja

Rule Path
Disallow /

nutch

Rule Path
Disallow /

octopus

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

planetwork

Rule Path
Disallow /

postrank

Rule Path
Disallow /

purebot

Rule Path
Disallow /

pycurl

Rule Path
Disallow /

queryn

Rule Path
Disallow /

queryseeker

Rule Path
Disallow /

radian6

Rule Path
Disallow /

radiation

Rule Path
Disallow /

realdownload

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scooter

Rule Path
Disallow /

seekerspider

Rule Path
Disallow /

semalt

Rule Path
Disallow /

siclab

Rule Path
Disallow /

sindice

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

skygrid

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

stackrambler

Rule Path
Disallow /

stripper

Rule Path
Disallow /

sucker

Rule Path
Disallow /

surftbot

Rule Path
Disallow /

sux0r

Rule Path
Disallow /

suzukacz

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

true_robots

Rule Path
Disallow /

turingos

Rule Path
Disallow /

turnit

Rule Path
Disallow /

vampire

Rule Path
Disallow /

vikspider

Rule Path
Disallow /

voideye

Rule Path
Disallow /

webleacher

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webvac

Rule Path
Disallow /

webviewer

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

wwwoffle

Rule Path
Disallow /

woxbot

Rule Path
Disallow /

xaldon

Rule Path
Disallow /

xxxyy

Rule Path
Disallow /

yamanalab

Rule Path
Disallow /

yioopbot

Rule Path
Disallow /

youda

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

zune

Rule Path
Disallow /

zyborg

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.handgefertigtes.de/sitemap/sitemap.xml
Back to top

Comments

  • Sitemap
  • Crawlers Setup
  • Paths (clean URLs)
  • Disallow: /catalog/category/view/
  • Disallow: /catalog/product/view/
  • Files
  • System files
  • PHP
  • Pinterest Crawler erlauben
Back to top

Warnings

  • 2 invalid lines.
Back to top