Skip to content

Conversation

@gabriben
Copy link
Contributor

@gabriben gabriben commented Sep 9, 2025

Make sure that Qwen3 is in non_thinking mode

return "".join([l["response"] for l in lines])


def batch_invoke_sagemaker_endpoint(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we verify that this has been tested?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is an edge case, that we do not use often for now

@gabriben gabriben merged commit 0ffab95 into main Nov 25, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants