Overview

mcp-kafka is a server-side implementation of the model context protocol (MCP) for Apache Kafka. It allows language models (LLM/SLM) to reliably interact with Kafka & its ecosystem, including Kafka Connect, Burrow, & Cruise Control.

NOTE: This is a WIP, changes/potential errors are expected.

Features

The server supports capabilities based on the core Kafka APIs, excluding Streams (for now), along with the Burrow & Cruise Control REST APIs.

TODO

• Use asyncio and aiohttp.
• Set env config values in the data class.
• Finish admin/consumer/producer API support.
• Support Burrow API.
• Support CC API.
• Service + integration tests.
• Publish to PyPI (uv pip install mcp-kafka)
• Test Dockerfile & push to Dockerhub (docker pull bkpowers/mcp-kafka)
• Usage/config/deployment options + demo in README.
• Consider Strimzi/kcctl integrations.
• Prompts with auto-complete support for certain resources/tools.

MCP Capabilities

Tools

Kafka

• consume
• produce
• describe_kafka_cluster
• describe_kafka_topics
• describe_kafka_consumer_groups
• describe_kafka_delegation_tokens
• describe_kafka_log_dirs
• describe_kafka_configs
• describe_kafka_acls

Kafka Connect

• get_kafka_connect_cluster_info
• get_kafka_connect_config
• get_kafka_connect_connectors
• get_kafka_connect_connector_plugins
• get_kafka_connect_loggers

Burrow

• burrow_healthcheck
• burrow_list_clusters
• burrow_describe_cluster
• burrow_list_consumers_with_group_detail
• burrow_list_topics
• burrow_check_consumer_group_status

Cruise Control

• cruise_control_get_state
• cruise_control_get_kafka_cluster_load
• cruise_control_get_partition_resource_utilization_and_load
• cruise_control_get_partition_and_replica_state
• cruise_control_get_optimization_proposals
• cruise_control_get_user_request_result

Resources

• topic, connector, consumer group

Prompts

Usage / Configuration

1. Claude Desktop
2. Cursor
3. Windsurf
4. Langchain MCP adapter
5. Azure OpenAI

Environment Variables

Supported APIs are (currently) enabled by the presence of their specific environment variable. If none are present, the server responds as empty. If 1 or more variables are present, then the respective tools are also present.

• KAFKA_BOOTSTRAP_SERVERS: Kafka Admin, Consumer, Producer APIs
• KAFKA_CONNECT_API_URL: Kafka Connect API
• KAFKA_BURROW_API_URL: Burrow API
• KAFKA_CRUISE_CONTROL_API_URL: Cruise Control API