Skip to content

Commit 15c50f7

Browse files
committed
add more comments
Signed-off-by: Nick Hill <[email protected]>
1 parent 8c3bc3b commit 15c50f7

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

vllm/v1/engine/core.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1044,7 +1044,10 @@ def process_input_sockets(
10441044
request = generic_decoder.decode(data_frames)
10451045

10461046
if request_type == EngineCoreRequestType.ABORT:
1047-
# Aborts are added to *both* queues.
1047+
# Aborts are added to *both* queues, allows us to eagerly
1048+
# process aborts while also ensuring ordering in the input
1049+
# queue to avoid leaking requests. This is ok because
1050+
# aborting in the scheduler is idempotent.
10481051
self.aborts_queue.put_nowait(request)
10491052

10501053
# Push to input queue for core busy loop.

0 commit comments

Comments
 (0)