Skip to content

GitLab

Unverified Commit 36fc439d authored by Yangcheng Li's avatar Yangcheng Li Committed by GitHub
Browse files

[Doc] fix doc string typo in block_manager `swap_out` function (#10212)

parent 874f551b
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
vllm/core/block_manager.py
View file @ 36fc439d
......@@ -393,7 +393,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
with num_lookahead_slots.
Args:
seq_group (SequenceGroup): The sequence group to swap in.
seq_group (SequenceGroup): The sequence group to swap out.
num_lookahead_slots (int): Number of lookahead slots used in
speculative decoding, default to 0.
......@@ -409,7 +409,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
swapping out the given sequence_group with num_lookahead_slots.
Args:
sequence_group (SequenceGroup): The sequence group to swap in.
sequence_group (SequenceGroup): The sequence group to swap out.
Returns:
List[Tuple[int, int]]: The mapping of swapping block from
......@@ -459,7 +459,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
on to the 'device'.
Args:
sequence_group (SequenceGroup): The sequence group to swap in.
sequence_group (SequenceGroup): The sequence group to swap in/out.
device (Device): device to swap the 'seq_group' on.
status (SequenceStatus): The status of sequence which is needed
for action. RUNNING for swap out and SWAPPED for swap in
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment