Skip to content

[magics] Allow model parameters to be specified #1452

@dlqqq

Description

@dlqqq

Problem

Allow users to specify model parameters (e.g. temperature) when invoking a model through the %%ai magic command.

Proposed Solution

Not sure. My initial guess is that:

  1. Common OpenAI-API-compatible parameters available to most LiteLLM models like temperature and top_k should be available as command-line flags.

  2. Additional arguments may be passed as a dictionary, e.g. --args={...}.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions