darc.de
robots.txt

Robots Exclusion Standard data for darc.de

Resource Scan

Scan Details

Site Domain darc.de
Base Domain darc.de
Scan Status Ok
Last Scan2024-10-20T16:58:16+00:00
Next Scan 2024-11-19T16:58:16+00:00

Last Scan

Scanned2024-10-20T16:58:16+00:00
URL https://darc.de/robots.txt
Redirect https://www.darc.de/robots.txt
Redirect Domain www.darc.de
Redirect Base darc.de
Domain IPs 162.55.103.62, 2a01:4f8:271:594d::2
Redirect IPs 162.55.103.62, 2a01:4f8:271:594d::2
Response IP 162.55.103.62
Found Yes
Hash 34bc44e883b5bda925ca98f76e9486f52a95d24545b5836016c105ca63d3eaec
SimHash 6e685873c860

Groups

*

Rule Path
Disallow /bin/
Disallow /local-bin/
Disallow /redaktionssystem/
Disallow /rundspruch/
Disallow /grafik/
Disallow /error/
Disallow /webstat/
Disallow /seitenpflege/
Disallow /mitglieder/
Disallow /fileadmin/_migrated/
Disallow /fileadmin/filemounts/distrikte/k/ortsverbaende/12/NOT-Funk_Einsatz_Konzept_Kurzfassung.pdf
Disallow /fileadmin/filemounts/distrikte/h/Referate/Notfunk/Neues_Notfunkkonzept.pdf
Disallow /der-club/distrikte/q/notfunkreferat/dokumente-notfunk/
Disallow /der-club/distrikte/h/notfunk/infoflyer/
Disallow /der-club/distrikte/o/ortsverbaende/02/notfunk/mein-handbuch-fuer-den-not-und-katastrophenfunk/
Disallow /fileadmin/filemounts/distrikte/k/ortsverbaende/12/NOT-Funk_Gruppe_K12_ZW.pdf
Disallow /fileadmin/filemounts/distrikte/w/Distriktseite_Sachsen-Anhalt/Dateien/Notfunk/Merkheft_W_Rev_1.3.pdf

Other Records

Field Value
crawl-delay 20

firefly/1.0

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

darcbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0