Skip to content

GitLab

Commit 2ce7c096 authored by xuxz's avatar xuxz
Browse files

[PD][Fixbug]修复CachedRequestData结构体升级找不到resumed_req_ids变量

parent 56cc2ac8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/distributed/kv_transfer/kv_connector/v1/du/du_swift_connector.py
View file @ 2ce7c096
...@@ -613,7 +613,7 @@ class DuSwiftConnector(KVConnectorBase_V1): ...@@ -613,7 +613,7 @@ class DuSwiftConnector(KVConnectorBase_V1):
for i, req_id in enumerate(cached_reqs.req_ids): for i, req_id in enumerate(cached_reqs.req_ids):
num_computed_tokens = cached_reqs.num_computed_tokens[i] num_computed_tokens = cached_reqs.num_computed_tokens[i]
new_block_ids = cached_reqs.new_block_ids[i] new_block_ids = cached_reqs.new_block_ids[i]
resumed_from_preemption = cached_reqs.resumed_from_preemption[i] resumed_from_preemption = req_id in cached_reqs.resumed_req_ids
if self.is_producer: if self.is_producer:
num_scheduled_tokens = ( num_scheduled_tokens = (
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment