Search results

[BUG]: Multimodal workers fail to register with frontend discovery system on SGLang Backend

bugSomething isn't workingSomething isn't working

Status: Open.

#4486 In ai-dynamo/dynamo;

· nancya-nv opened on Nov 19, 2025

[BUG]: No <code>usage</code> in response when tool calling

bugSomething isn't workingSomething isn't working

frontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`

observabilityRelated to metrics, tracing, loggingRelated to metrics, tracing, logging

Status: Open.

#4440 In ai-dynamo/dynamo;

· rmccorm4 opened on Nov 18, 2025

[BUG]: events-based KV-Router endlessly grows the RAM

bugSomething isn't workingSomething isn't working

Status: Open.

#4429 In ai-dynamo/dynamo;

· vladnosiv opened on Nov 18, 2025

[BUG]: output_token_throughput_per_user not equal to Tokens/sec per User on efficiency_tok_s_gpu_vs_user.png

bugSomething isn't workingSomething isn't working

Status: Open.

#4427 In ai-dynamo/dynamo;

· xiaoshaw opened on Nov 18, 2025

[BUG]: High TTFT Latency in Disaggregated Setup with moderate concurrency

bugSomething isn't workingSomething isn't working

Status: Open.

#4425 In ai-dynamo/dynamo;

· dineshkumar20 opened on Nov 18, 2025

[BUG]: planner scale doesn't work if user updates deployment replicas

bugSomething isn't workingSomething isn't working

Status: Open.

#4420 In ai-dynamo/dynamo;

· sozercan opened on Nov 18, 2025

[BUG]: planner does not set correct prom endpoint

bugSomething isn't workingSomething isn't working

Status: Open.

#4412 In ai-dynamo/dynamo;

· sozercan opened on Nov 17, 2025

[FEATURE]: Add --mm-prompt-template support to SGLang for multimodal prompt customization

backend::sglangRelates to the sglang backendRelates to the sglang backend

enhancementNew feature or requestNew feature or request

multimodal

Status: Open.

#4404 In ai-dynamo/dynamo;

· nancya-nv opened on Nov 17, 2025

[BUG]: missing SGLang metrics

bugSomething isn't workingSomething isn't working

Status: Open.

#4396 In ai-dynamo/dynamo;

· daiyaanarfeen opened on Nov 17, 2025

[FEATURE]: Multi-Tenancy

enhancementNew feature or requestNew feature or request

Status: Open.

#4388 In ai-dynamo/dynamo;

· nithin8702 opened on Nov 17, 2025

[FEATURE]: Layerwise KV Cache Transfer for Disaggregated TensorRT-LLM Serving

enhancementNew feature or requestNew feature or request

Status: Open.

#4387 In ai-dynamo/dynamo;

· shpgy-shpgy opened on Nov 17, 2025

[BUG]: DGDR config error when using aiconfigurator

bugSomething isn't workingSomething isn't working

Status: Open.

#4371 In ai-dynamo/dynamo;

· sozercan opened on Nov 15, 2025