Skip to content

GitLab

Unverified Commit 1a182387 authored by homeffjy's avatar homeffjy Committed by GitHub
Browse files

[Doc] Remove outdated comment to avoid misunderstanding (#9287)

parent 6cf1167c
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 4 deletions
vllm/core/block_manager_v2.py
View file @ 1a182387
...@@ -24,9 +24,8 @@ class BlockSpaceManagerV2(BlockSpaceManager): ...@@ -24,9 +24,8 @@ class BlockSpaceManagerV2(BlockSpaceManager):
autoregressively-generated tokens, and other advanced features such as autoregressively-generated tokens, and other advanced features such as
prefix caching, forking/copy-on-write, and sliding-window memory allocation. prefix caching, forking/copy-on-write, and sliding-window memory allocation.
The current implementation is partial; in particular prefix caching and This class implements the design described in
sliding-window are not feature complete. This class implements the design https://github.com/vllm-project/vllm/pull/3492.
described in https://github.com/vllm-project/vllm/pull/3492.
Lookahead slots Lookahead slots
The block manager has the notion of a "lookahead slot". These are slots The block manager has the notion of a "lookahead slot". These are slots
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment