-
Notifications
You must be signed in to change notification settings - Fork 6
Open
Description
I'd like to implement the Microsoft 1 bit quantized model:
https://huggingface.co/microsoft/bitnet-b1.58-2B-4T
My hope is it's small and fast and a lightweight model for quick tasks (an good for onboarding).
Example candle implementation: https://github.com/tomsanbear/bitnet-rs
Metadata
Metadata
Assignees
Labels
No labels