-
-
Notifications
You must be signed in to change notification settings - Fork 11.8k
[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable #29698
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request correctly fixes a TypeError in the DBO logic by adding a missing return statement. The change is correct and resolves the issue. I have added one comment with suggestions for further improving code quality and maintainability in the affected function.
|
NVM its flaky; holding off for now |
Signed-off-by: Lucas Wilkinson <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
95c9780 to
a1aedc6
Compare
…rable (vllm-project#29698) Signed-off-by: Lucas Wilkinson <[email protected]>
…rable (vllm-project#29698) Signed-off-by: Lucas Wilkinson <[email protected]> Signed-off-by: Hashem Hashemi <[email protected]>
… not iterable (vllm-project#29698)" This reverts commit e23f665.
…rable (vllm-project#29698) Signed-off-by: Lucas Wilkinson <[email protected]> Signed-off-by: Xingyu Liu <[email protected]>
…rable (vllm-project#29698) Signed-off-by: Lucas Wilkinson <[email protected]>
#28579 broke DBO but was hidden by existing test failures on the nightly (#28893, with those fixed this now showed up)
Test Plan:
Fails on Main, Passes on this PR
NOTE: using
padded_second_ubatch_sliceinstead ofubatch_slices[1].request_slicefor requests was a bug that pre-dated #28579 but was just exacerbated by it