Skip to content

GitLab

Unverified Commit b21f0f9d authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[V1][Minor] Remove outdated comment (#12928) 


Signed-off-by: default avatarWoosuk Kwon <woosuk.kwon@berkeley.edu>
parent 45cbc499
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
vllm/v1/core/kv_cache_manager.py
View file @ b21f0f9d
...@@ -299,9 +299,7 @@ class KVCacheManager: ...@@ -299,9 +299,7 @@ class KVCacheManager:
While all scheduled requests must be in the RUNNING state, the inverse While all scheduled requests must be in the RUNNING state, the inverse
is not necessarily true. There may be RUNNING requests that are not is not necessarily true. There may be RUNNING requests that are not
scheduled in the current step. As of 1/1/2025, the scheduler does not scheduled in the current step.
allow this case, but it is possible in the future, as we allow more
flexible scheduling.
This can result in an edge case where the number of common prefix blocks This can result in an edge case where the number of common prefix blocks
is 0, even though all scheduled requests share a common prefix. This is 0, even though all scheduled requests share a common prefix. This
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment