Unverified Commit 9ef3b718 authored by Chauncey's avatar Chauncey Committed by GitHub
Browse files

[Bugfix] Fix Can't instantiate abstract class DeepseekV32IndexerBackend (#33052)


Signed-off-by: default avatarchaunceyjiang <chaunceyjiang@gmail.com>
parent bb17e8f1
...@@ -302,7 +302,7 @@ class NixlConnector(KVConnectorBase_V1): ...@@ -302,7 +302,7 @@ class NixlConnector(KVConnectorBase_V1):
@property @property
def prefer_cross_layer_blocks(self) -> bool: def prefer_cross_layer_blocks(self) -> bool:
backend = get_current_attn_backend(self._vllm_config) backend = get_current_attn_backend(self._vllm_config)
if backend().get_name() not in ( if backend.get_name() not in (
"FLASH_ATTN", "FLASH_ATTN",
"FLASHINFER", "FLASHINFER",
): ):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment