How to change temperature?

[fernandomiletto]

I have always used predefined models from OpenAI, particularly Gpt-3.5-Turbo. However, now I am facing a problem that requires a more deterministic model. How can I define a model specifying the desired model, the temperature, and my API key?

[HavenDV]

You can use:

• provider level settings: OpenAiProvider.ChatSettings property
• model level settings: OpenAiChatModel.Settings property
• request level settings: specify settings parameter in GenerateAsync

just assign a new OpenAiChatSettings() and specify properties to override. It will use more high level setting value or default if not specified.

it same for all models/providers but not all providers have specific settings classes like OpenAiChatSettings

also it will be return usedSettings in response:

[fernandomiletto]

@HavenDV, could you provide an example of how to implement a temperature setting of 0.4 with the GPT-3.5 Turbo model? I attempted to implement it, but it didn't work.

[danijerez]

I think the error message is clear.

Init-only property or indexer 'OpenAiChatSettings.Temperature' can only be assigned in an object initializer, or on 'this' or 'base' in an instance constructor or an 'init' accessor.

Try doing the initialization like this:

var settings = new OpenAiChatSettings { Temperature = 0.5 };