-
Notifications
You must be signed in to change notification settings - Fork 41
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Context
When running heavy console applications in non interactive mode (e.g a heavy LLM which can take hours to process) the stdout is flushed only on every new line, meaning it's impossible to see intermediary sentence output tokens being generated lively, ideally we want let users hacking to see what is being generated in the console.
Possible solutions
We could add new runtime option to set stdout flushing scheme (e,g every new line, every character, or never flush).
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request
Type
Projects
Status
Todo