Why bias isn't optional in pallas rmsnorm kernel? #32645
Unanswered
AakashKumarNain
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I know that as per the RMSNorm paper, we can formulate RMSNorm with a bias parameter, but in most cases it is not used. Right now, the pallas kernel makes bias a mandatory parameter which is not ideal. Is there a reason for doing so?
Beta Was this translation helpful? Give feedback.
All reactions