Skip to content

GitLab

Unverified Commit 15b8fef4 authored by TaoYu Chen's avatar TaoYu Chen Committed by GitHub
Browse files

Remove redundant assignment in xfer_buffers, This is a little fix (#24732) 


Signed-off-by: default avatarChenTaoyu-SJTU <ctynb@qq.com>
parent cfa3234a
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
vllm/distributed/kv_transfer/kv_connector/v1/nixl_connector.py
View file @ 15b8fef4
...@@ -708,8 +708,6 @@ class NixlConnectorWorker: ...@@ -708,8 +708,6 @@ class NixlConnectorWorker:
caches_data = [] caches_data = []
# With hybrid allocator, layers can share a kv cache tensor # With hybrid allocator, layers can share a kv cache tensor
seen_base_addresses = [] seen_base_addresses = []
xfer_buffers = (self.host_xfer_buffers
if self.use_host_buffer else kv_caches)
# Note(tms): I modified this from the original region setup code. # Note(tms): I modified this from the original region setup code.
# K and V are now in different regions. Advantage is that we can # K and V are now in different regions. Advantage is that we can
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment