You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The api_base: str parameter sets the base URL where LLM requests are sent. This is a common feature request from enterprise users who are using LLMs through a proxy gateway (e.g. https://192.168.X.Y).