Skip to content

GitLab

Unverified Commit d4db9b02 authored by shilinlee's avatar shilinlee Committed by GitHub
Browse files

fix: the store_dtype typo for ascend mla (#9208) 


Signed-off-by: default avatarshilinlee_com <836160610@qq.com>
parent f7dd651d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/mem_cache/memory_pool.py
View file @ d4db9b02
......@@ -951,7 +951,7 @@ class AscendMLAPagedTokenToKVPool(MLATokenToKVPool):
cache_k = cache_k.to(self.dtype)
if self.store_dtype != self.dtype:
cache_k = cache_k.view(store_dtype)
cache_k = cache_k.view(self.store_dtype)
import torch_npu
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment