Unverified Commit d6aeaddf authored by kx's avatar kx Committed by GitHub
Browse files

[bugfix] fix type[AttentionBackend] bug in kv_connector_base_v1 (#30051)


Signed-off-by: default avatar01267596 <xiongkai123@cmbchina.com>
Co-authored-by: default avatar01267596 <xiongkai123@cmbchina.com>
parent a238cbd8
......@@ -239,7 +239,7 @@ class KVConnectorBase_V1(ABC):
return
def register_cross_layers_kv_cache(
self, kv_cache: torch.Tensor, attn_backend: type[AttentionBackend]
self, kv_cache: torch.Tensor, attn_backend: type["AttentionBackend"]
):
"""
Initialize with a single KV cache tensor used by all layers.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment