opendata.meerbusch.de
robots.txt

Robots Exclusion Standard data for opendata.meerbusch.de

Resource Scan

Scan Details

Site Domain opendata.meerbusch.de
Base Domain meerbusch.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-11T20:41:38+00:00
Next Scan 2025-11-09T20:41:38+00:00

Last Successful Scan

Scanned2022-06-25T04:32:11+00:00
URL https://opendata.meerbusch.de/robots.txt
Response IP 35.205.166.46
Found Yes
Hash 00e7e5a09c8ee244251265532bebda69c2b52c9a5ced7ca7e3dd359b8638cb33
SimHash 4d30cc20a202

Groups

*

Rule Path
Disallow /dataset/rate/
Disallow /revision/
Disallow /dataset/*/history
Disallow /api/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10