Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
1a182387
Unverified
Commit
1a182387
authored
Oct 12, 2024
by
homeffjy
Committed by
GitHub
Oct 11, 2024
Browse files
[Doc] Remove outdated comment to avoid misunderstanding (#9287)
parent
6cf1167c
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
4 deletions
+3
-4
vllm/core/block_manager_v2.py
vllm/core/block_manager_v2.py
+3
-4
No files found.
vllm/core/block_manager_v2.py
View file @
1a182387
...
...
@@ -24,9 +24,8 @@ class BlockSpaceManagerV2(BlockSpaceManager):
autoregressively-generated tokens, and other advanced features such as
prefix caching, forking/copy-on-write, and sliding-window memory allocation.
The current implementation is partial; in particular prefix caching and
sliding-window are not feature complete. This class implements the design
described in https://github.com/vllm-project/vllm/pull/3492.
This class implements the design described in
https://github.com/vllm-project/vllm/pull/3492.
Lookahead slots
The block manager has the notion of a "lookahead slot". These are slots
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment