在scaled_dot_product_attention函数中，改为如果输入是3D，输出也是3D #601
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
modified: paconvert/api_matcher.py modified: tests/test_scaled_dot_product_attention.py
modified: tests/test_scaled_dot_product_attention.py
zhwesky2010
reviewed
Jul 28, 2025
| import torch | ||
| np.random.seed(100) | ||
| x = np.random.rand(8, 128, 64) | ||
| query = torch.tensor(x, dtype=torch.float16) |
There was a problem hiding this comment.
这个在CPU下目前还不支持bfloat16。所以跑不了。
zhwesky2010
reviewed
Jul 28, 2025
嗯，收到 |
先修改下case吧，看看怎么能测到这个3D的功能，同时又能避开后端选择错误的问题。先把这个PR合入进去。 |
modified: tests/test_scaled_dot_product_attention.py
|
在case10中暂时考虑了mask |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Docs
PaddlePaddle/Paddle#73804
PR APIs
新增参数
优化功能
解决bug
LayerList.insert,bernoulli,Tensor.data,LSTMCell,fused_rms_norm,softmaxatleast和to_tensor和解决bug中的函数不需要修改PaConvert和Docs