Discussions

• 1 You must be logged in to vote

  🙏

  Send a batch of requests

  arty-abramovich-cyera asked May 9, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  500 Error with Anthropic Claude 3 Opus model on Vertex AI

  whalygood asked Apr 18, 2024 in Q&A · Answered

  

  

  

  

  7
• 1 You must be logged in to vote

  💡

  Prompt template with jinja2 - replace and improve prompts on the fly - need feedback

  shuther started Apr 29, 2024 in Ideas

  

  

  4
• 1 You must be logged in to vote

  💬

  [Bug]: H Using athina as the success_callback will cause CPU usage to reach 90%

  bug Something isn't working

  Caixiaopig started Apr 7, 2024 in General

  

  

  

  

  6
• 4 You must be logged in to vote

  🙌

  LiteLLM Proxy Configuration File Generator

  CXwudi started Apr 26, 2024 in Show and tell

  

  

  3
• 1 You must be logged in to vote

  💬

  safety_settings doesn't work for Gemini

  MichaelZhangCN started Apr 25, 2024 in General

  

  

  2
• 2 You must be logged in to vote

  🙏

  VertexAIException - Expecting value: line 1 column 1 (char 0) on Cloud Run

  whalygood asked Apr 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is Integrating LITELLM+Anthropic with Autogen Possible?

  Swoyam1 asked Apr 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Load balancing between Anthropic and AWS/GCP hosted Claude models

  cwang started Apr 13, 2024 in General · Closed

  

  

  4
• 1 You must be logged in to vote

  💬

  [Resolved ✅ ] Potential security vulnerability

  bug Something isn't working

  Fewword started Apr 10, 2024 in General

  

  

  

  

  21
• 1 You must be logged in to vote

  🙏

  Does litellm support multi slash form model name with OpenAI-Compatible Endpoints?

  Genuifx asked Apr 2, 2024 in Q&A · Answered

  

  

  1
• 2 You must be logged in to vote

  💡

  Offline inference over multiple vLLM instances

  nivibilla started Nov 23, 2023 in Ideas

  

  

  

  

  13
• 2 You must be logged in to vote

  🙏

  Quesetion about LiteLLM integration with AWS Sagemaker endpoint

  luciameng1989 asked Mar 22, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  merging consecutive anthropic messages

  bug Something isn't working

  morgante started Mar 23, 2024 in General

  

  

  

  

  11
• 1 You must be logged in to vote

  💬

  [Env issue - HELP] UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte

  bug Something isn't working

  Politas380 started Mar 15, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  [Help]: Model 'command-xlarge-beta', not recognized

  bug Something isn't working

  GillesMoyse started Mar 14, 2024 in General

  

  

  8
• 2 You must be logged in to vote

  💬

  [Feature]: "local/" model prefix to use LOCAL_API_URL and LOCAL_API_KEY env variables

  enhancement New feature or request

  jakobdylanc started Mar 2, 2024 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  Can two litellm instances share the same postgresql database?

  Elijas asked Mar 7, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is it possible to avoid using environment variables?

  Elijas asked Mar 7, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  is there any possibility to create local proxy server for apis like gemini,groq? because right now i see that option for local models only

  Greatz08 started Mar 2, 2024 in General · Closed

  

  

  2
• 1 You must be logged in to vote

  💬

  Improving DB Querying

  krrishdholakia started Mar 6, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Tool calling / instructor

  twardoch started Mar 1, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Ollama llava proxy_server_config.yaml and curl request

  fatihyildizhan asked Feb 7, 2024 in Q&A · Answered

  

  

  

  

  9
• 1 You must be logged in to vote

  💬

  CNCF TAG-Runtime or/and CNCF Cloud Native WG discussion

  raravena80 started Feb 27, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to call Hugging face TGI end point using liteLLM ?

  ansSanthoshM asked Feb 27, 2024 in Q&A · Closed · Unanswered

  

  

  3