Skip to content

Release 5.2.0

Choose a tag to compare

@awaescher awaescher released this 30 May 11:26
· 96 commits to main since this release
  • Add support for think and thinking with Ollama 0.9 #254 - thanks @mili-tan

Important notes

The Think parameter controls whether the models are allowed to reason and how the reasoning tokens are handled.

Reasoning model Marked "thinking" in Ollama library Think=false Think=true
Yes Yes Disables reasoning Enables reasoning + Separates reasoning tokens in Message.Thinking
Yes No Reasoning stays enabled + Reasoning tags will appear as <think></think> in the models response Error: Model does not support thinking → Download the model again
No No No effect Error: Model does not support thinking