Question: Differerence between mesos-kafka & DCOS-kafka-service?

[NNSatyaKarthik]

I’m doing a POC to deploy Kafka as an application on Mesos Cluster. I came across these 2 codebases on github. One developed by apache-mesos (github page) & other developed by mesosphere and can run only on DCOS (github page).

Question: Would like to know if there are any differences between DCOS-Kafka & mesos-Kafka in terms of features and extended functionality.

Regarding Mesos-Kafka:
I don’t see active participation on github (and some open issues) for mesos-kafka in the past months. Can I assume that the service is robust enough that I can use in production environment? Any Inputs on this would be helpful.

// Not sure if this is the correct place to ask or not.

[deric]

dcos-kafka-service is outdated and deprecated. The successor is DC/OS Kafka (or at least we can call it that way, there are many other kafka versions in the DC/OS Universe).

DC/OS Kafka is build on top of DC/OS commons project that aims to simplify deploying of statefull services by sharing some common functionality. Thus when using DC/OS (Mesos and approximately 30 other services running on top of your OS) you can benefit from:

• load-balanced Kafka broker endpoints
• easy broker adding (almost impossible to remove a broker)
• CLI integration as simple as dcos kafka topic list
• kafka 0.11 and 1.0 are both available

On the other hand, mesos/kafka supports:

• topic rebalancing
• updating topics
• setting setting different configuraition per each broker
• removing brokers

My impression is that currently the DC/OS project offers only limited functionality in terms of service maintenance. Although if you're more interested in newer kafka broker version it might be better choice.