Skip to content

GitLab

Unverified Commit 32142b3c authored by Simon Mo's avatar Simon Mo Committed by GitHub
Browse files

[Bugfix] Fix eviction cached blocked logic (#21357) 


Signed-off-by: default avatarsimon-mo <simon.mo@hey.com>
parent 82b8027b
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/core/block_pool.py
View file @ 32142b3c
...@@ -253,7 +253,7 @@ class BlockPool: ...@@ -253,7 +253,7 @@ class BlockPool:
return False return False
block.reset_hash() block.reset_hash()
blocks_by_id.pop(block.block_id, None) blocks_by_id.pop(block.block_id, None)
if blocks_by_id: if len(blocks_by_id) == 0:
del self.cached_block_hash_to_block[block_hash] del self.cached_block_hash_to_block[block_hash]
if self.enable_kv_cache_events: if self.enable_kv_cache_events:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment