Unverified Commit 15455dff authored by Ziqi Fan's avatar Ziqi Fan Committed by GitHub
Browse files

fix: set correct parent_hash for each kv block when publish kv events (#671)

parent 02a33f15
......@@ -315,6 +315,7 @@ class BaseTensorrtLLMEngine:
tokens,
lora_id,
)
parent_hash = block["block_hash"]
elif data["type"] == "removed":
for block_hash in data["block_hashes"]:
self._kv_cache_events_publisher.removed_event(block_hash)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment