Skip to content

GitLab

Unverified Commit f9076a5a authored by Zhiqiang Xie's avatar Zhiqiang Xie Committed by GitHub
Browse files

hot fix for mooncake batch set api (#9836)

parent 646076b7
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/srt/mem_cache/storage/mooncake_store/mooncake_store.py
View file @ f9076a5a
...@@ -159,6 +159,7 @@ class MooncakeStore(HiCacheStorage): ...@@ -159,6 +159,7 @@ class MooncakeStore(HiCacheStorage):
def batch_set( def batch_set(
self, self,
keys: List[str], keys: List[str],
values: Optional[List[torch.Tensor]] = None,
target_location: Optional[List[int]] = None, target_location: Optional[List[int]] = None,
target_sizes: Optional[List[int]] = None, target_sizes: Optional[List[int]] = None,
) -> bool: ) -> bool:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment