Skip to content

[FEATURE]: Multi-Tenancy #4388

@nithin8702

Description

@nithin8702

Feature request

We would like to Serve Single Model for Multiple Projects using api keys. Each Project should have unique api keys. Also capture the tokens for each Projects or API Keys.

Describe the problem you're encountering

In an Enterprise, we are duplicating instances for each project, Causing lesser GPU Utilisation.

Describe alternatives you've tried

LiteLLM Proxy Server which has Teams, Projects, Org. It also has good token capturing.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions