promigate.de
robots.txt

Robots Exclusion Standard data for promigate.de

Resource Scan

Scan Details

Site Domain promigate.de
Base Domain promigate.de
Scan Status Ok
Last Scan2025-08-27T03:26:43+00:00
Next Scan 2025-09-03T03:26:43+00:00

Last Scan

Scanned2025-08-27T03:26:43+00:00
URL https://promigate.de/robots.txt
Redirect https://www.promigate.de/robots.txt
Redirect Domain www.promigate.de
Redirect Base promigate.de
Domain IPs 193.108.136.178
Redirect IPs 193.108.136.178
Response IP 193.108.136.178
Found Yes
Hash 37d96639853909f2f33ffe526532ed2a0ba26d2e7b88d9c921f195164f9cd6ba
SimHash 2434c8c2d113

Groups

*

Rule Path
Disallow /admin/
Disallow /bt/
Disallow /user/
Disallow /doku/
Disallow /links/
Disallow /grafik/
Disallow /iframe/
Disallow /mail/
Disallow /intranet/
Disallow /emergency/
Disallow /data/
Disallow /phptest/
Disallow /tagi/
Disallow /u1/
Disallow /wimpy/
Disallow /CFIDE/
Disallow /helpservices/
Disallow /netmon/
Disallow /uid/

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /