Skip to content

GitLab

Unverified Commit d1572160 authored by Kunshang Ji's avatar Kunshang Ji Committed by GitHub
Browse files

[BUGFIX][Mamba] Use uint64 for address in KVBlockZeroer (#37197) 


Signed-off-by: default avatarKunshang Ji <kunshang.ji@intel.com>
parent 93f3c8e5
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/worker/utils.py
View file @ d1572160
......@@ -180,7 +180,7 @@ class KVBlockZeroer:
)
self._ids_gpu = torch.empty(self._id_cap, dtype=torch.int64, device=self.device)
self._meta = (
torch.tensor(seg_addrs, dtype=torch.int64, device=self.device),
torch.tensor(seg_addrs, dtype=torch.uint64, device=self.device),
page_size_el,
blk_size,
len(seg_addrs),
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment