dunklesauge.de
robots.txt
Robots Exclusion Standard data for dunklesauge.de
Resource Scan
Scan Details
| Site Domain | dunklesauge.de |
| Base Domain | dunklesauge.de |
| Scan Status | Ok |
| Last Scan | 2026-02-12T00:51:18+00:00 |
| Next Scan | 2026-03-14T00:51:18+00:00 |
Last Scan
| Scanned | 2026-02-12T00:51:18+00:00 |
| URL | http://dunklesauge.de/robots.txt |
| Domain IPs | 85.13.154.132 |
| Response IP | 85.13.154.132 |
| Found | Yes |
| Hash | 5f075f4cd4a2667cc57de791db86eb726c6a48ef06765203030c92e9e681bbf0 |
| SimHash | 9a1359689712 |
Groups
crawl.baidu.com
baiduspider
baiduspider
archive.org_bot
mail.ru_bot
mj12bot
obot
istellabot
easouspider
dbot
zookabot
proximic
crystalsemanticsbot
larbin
blexbot
ubicrawler
unisterbot
doc
zao
zealbot
msiecrawler
fetch
offline explorer
teleport
teleportpro
webzip
linko
microsoft.url.control
xenu
larbin
zyborg
download ninja
grub-client
k2spider
npbot
smartviper
urlmetriken
psbot
gigabot
baiduspider
nutch
cityreview
penthesilea
prlog
zealbot
libwww
zyborg
sogou web spider
java
add catalog
voilabot
vagabondo
turnitinbot
nerdybot
seznambot
wsr-agent
coccoc
careerbot
cpython
meanpathbot
euripbot
python-requests
| Rule | Path |
|---|---|
| Disallow | / |
ezooms.bot
yandexbot
yandex
yandex bot
careerbot
tencenttraveler
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /galerie/ |
| Disallow | /1images/ |
| Disallow | /1mail1/ |
| Disallow | /Wunschbox/ |
| Disallow | /dA_counter/ |
| Disallow | /images/ |
| Disallow | /mailer/ |
| Disallow | /shoutbo01/ |
| Disallow | /*giremiyorum*.* |
| Disallow | /*betsson11*.* |
| Disallow | /*bets10*.* |
| Disallow | /*toplist39*.* |
*
No rules defined. All paths allowed.
Warnings
- 1 invalid line.
Comments