Unverified Commit 1a182387 authored by homeffjy's avatar homeffjy Committed by GitHub
Browse files

[Doc] Remove outdated comment to avoid misunderstanding (#9287)

parent 6cf1167c
......@@ -24,9 +24,8 @@ class BlockSpaceManagerV2(BlockSpaceManager):
autoregressively-generated tokens, and other advanced features such as
prefix caching, forking/copy-on-write, and sliding-window memory allocation.
The current implementation is partial; in particular prefix caching and
sliding-window are not feature complete. This class implements the design
described in https://github.com/vllm-project/vllm/pull/3492.
This class implements the design described in
https://github.com/vllm-project/vllm/pull/3492.
Lookahead slots
The block manager has the notion of a "lookahead slot". These are slots
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment