"vscode:/vscode.git/clone" did not exist on "27feead2f80f906de88d64c6e69342451cf1d7f0"
Commit 16d88e40 authored by 王敏's avatar 王敏
Browse files

[fix]解决test_model_input中报的找不到move_cache错误

parent 6d13278b
...@@ -60,6 +60,16 @@ class MockAttentionBackend(AttentionBackend): ...@@ -60,6 +60,16 @@ class MockAttentionBackend(AttentionBackend):
) -> None: ) -> None:
pass pass
@staticmethod
def move_cache(
kv_caches: List[torch.Tensor],
src_to_dists: torch.Tensor,
kv_cache_dtype: str,
num_kv_heads: int,
head_size: int,
) -> None:
NotImplementedError
def test_model_runner_input(): def test_model_runner_input():
sampling_metadata = SamplingMetadata( sampling_metadata = SamplingMetadata(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment