Skip to content

Commit 602634f

Browse files
rwightmanrwightman
committed
Add some addition attention impl, inspired by PR #2048. Add some basic unit tests to cover broader timm pooling options. Make ROPE pooling more flexible with latest RotaryEmbedding impl.
1 parent 6da5fd7 commit 602634f

File tree

6 files changed

+1007
-6
lines changed

6 files changed

+1007
-6
lines changed

0 commit comments

Comments
 (0)