Add Support for KIP-848 - The Next Generation of the Consumer Rebalance Protocol

[theonlyguyy]

Hi Redpanda Console Team.
My company is currently in the process of migrating our Kafka clusters to KRaft. With KRaft clusters comes support for various new features in Kafka, one of them being KIP-848 - The Next Generation of the Consumer Rebalance Protocol.

We have been using Redpanda Console UI for our Kafka clusters, and have tried using this new protocol on a consumer group in the newest Redpanda Console UI version, but the UI shows the cosumer group to be in a DEAD state.

If this is a feature that currently exists, but has been missed by us, we would really appreciate if you could point out the config that we may have missed. Otherwise, if this feature is still not supported we would really appreciate if this could be added to the list of features to implement.

Thanks In advance for your help.

Environment Reference,

• Kafka version - 3.9.0
• Redpanda Console Version - v3.1.0

[weeco]

Hey @theonlyguyy ,
thanks for raising this issue. I haven't been able to test this KIP yet. I'm interested in helping, but frankly I'm unsure when we'll actually going to implement it. If you are eager to help, I'm happy to assist.

A good first step would be creating an environment (docker compose) where we have both consumers using the old rebalance protocol and some next gen consumer group. I'm not entirely sure whether we already got everything we need from the Kafka client to support this, but it's already on twmb's list here: twmb/franz-go#952