Unverified Commit 15455dff authored by Ziqi Fan's avatar Ziqi Fan Committed by GitHub
Browse files

fix: set correct parent_hash for each kv block when publish kv events (#671)

parent 02a33f15
...@@ -315,6 +315,7 @@ class BaseTensorrtLLMEngine: ...@@ -315,6 +315,7 @@ class BaseTensorrtLLMEngine:
tokens, tokens,
lora_id, lora_id,
) )
parent_hash = block["block_hash"]
elif data["type"] == "removed": elif data["type"] == "removed":
for block_hash in data["block_hashes"]: for block_hash in data["block_hashes"]:
self._kv_cache_events_publisher.removed_event(block_hash) self._kv_cache_events_publisher.removed_event(block_hash)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment