andreas-leonhardt.de
robots.txt

Robots Exclusion Standard data for andreas-leonhardt.de

Resource Scan

Scan Details

Site Domain andreas-leonhardt.de
Base Domain andreas-leonhardt.de
Scan Status Ok
Last Scan2024-09-30T01:01:05+00:00
Next Scan 2024-10-30T01:01:05+00:00

Last Scan

Scanned2024-09-30T01:01:05+00:00
URL https://www.andreas-leonhardt.de/robots.txt
Domain IPs 167.235.76.111
Response IP 167.235.76.111
Found Yes
Hash ab30a834f5f748f2d35f1449e5473bdc811ab5476b575f2370e9dfa76f422136
SimHash 7696c6e86183

Groups

acontbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

botonparade

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

envolk

Rule Path
Disallow /

eurobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

gonzo*

Rule Path
Disallow /

holmes

Rule Path
Disallow /

httrack

Rule Path
Disallow /

iccrawler - icjobs

Rule Path
Disallow /

isidorus

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

moosebot

Rule Path
Disallow /

openx spider

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

privacyfinder

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

speedy

Rule Path
Disallow /

stackrambler

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

touche

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yanga worldsearch bot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /wd/db-eeepc/
Disallow /t3site/fileadmin/
Disallow /t3site/t3lib/
Disallow /t3site/typo3/
Disallow /t3site/typo3_src/
Disallow /t3site/typo3conf/
Disallow /t3site/typo3temp/
Disallow /t3site/uploads/
Disallow /t3site/hauptmenue/kalender/cal/
Disallow /t3site/hauptmenue/kalender/ereignisansicht/
Disallow /t3site/hauptmenue/bildergalerie/
Allow /