Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
36fc439d
Unverified
Commit
36fc439d
authored
Nov 12, 2024
by
Yangcheng Li
Committed by
GitHub
Nov 11, 2024
Browse files
[Doc] fix doc string typo in block_manager `swap_out` function (#10212)
parent
874f551b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
vllm/core/block_manager.py
vllm/core/block_manager.py
+3
-3
No files found.
vllm/core/block_manager.py
View file @
36fc439d
...
@@ -393,7 +393,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
...
@@ -393,7 +393,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
with num_lookahead_slots.
with num_lookahead_slots.
Args:
Args:
seq_group (SequenceGroup): The sequence group to swap
in
.
seq_group (SequenceGroup): The sequence group to swap
out
.
num_lookahead_slots (int): Number of lookahead slots used in
num_lookahead_slots (int): Number of lookahead slots used in
speculative decoding, default to 0.
speculative decoding, default to 0.
...
@@ -409,7 +409,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
...
@@ -409,7 +409,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
swapping out the given sequence_group with num_lookahead_slots.
swapping out the given sequence_group with num_lookahead_slots.
Args:
Args:
sequence_group (SequenceGroup): The sequence group to swap
in
.
sequence_group (SequenceGroup): The sequence group to swap
out
.
Returns:
Returns:
List[Tuple[int, int]]: The mapping of swapping block from
List[Tuple[int, int]]: The mapping of swapping block from
...
@@ -459,7 +459,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
...
@@ -459,7 +459,7 @@ class SelfAttnBlockSpaceManager(BlockSpaceManager):
on to the 'device'.
on to the 'device'.
Args:
Args:
sequence_group (SequenceGroup): The sequence group to swap in.
sequence_group (SequenceGroup): The sequence group to swap in
/out
.
device (Device): device to swap the 'seq_group' on.
device (Device): device to swap the 'seq_group' on.
status (SequenceStatus): The status of sequence which is needed
status (SequenceStatus): The status of sequence which is needed
for action. RUNNING for swap out and SWAPPED for swap in
for action. RUNNING for swap out and SWAPPED for swap in
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment