Commit 16d88e40 authored by 王敏's avatar 王敏
Browse files

[fix]解决test_model_input中报的找不到move_cache错误

parent 6d13278b
......@@ -60,6 +60,16 @@ class MockAttentionBackend(AttentionBackend):
) -> None:
pass
@staticmethod
def move_cache(
kv_caches: List[torch.Tensor],
src_to_dists: torch.Tensor,
kv_cache_dtype: str,
num_kv_heads: int,
head_size: int,
) -> None:
NotImplementedError
def test_model_runner_input():
sampling_metadata = SamplingMetadata(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment