Unverified Commit 9ef3b718 authored by Chauncey's avatar Chauncey Committed by GitHub
Browse files

[Bugfix] Fix Can't instantiate abstract class DeepseekV32IndexerBackend (#33052)


Signed-off-by: default avatarchaunceyjiang <chaunceyjiang@gmail.com>
parent bb17e8f1
......@@ -302,7 +302,7 @@ class NixlConnector(KVConnectorBase_V1):
@property
def prefer_cross_layer_blocks(self) -> bool:
backend = get_current_attn_backend(self._vllm_config)
if backend().get_name() not in (
if backend.get_name() not in (
"FLASH_ATTN",
"FLASHINFER",
):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment