[Bugfix] Fix import `gemm_afp4wfp4` failure on AMD (#26068)

Signed-off-by: zhewenli <zhewenli@meta.com>

[Bugfix] Fix import `gemm_afp4wfp4` failure on AMD (#26068)
Signed-off-by: zhewenli <zhewenli@meta.com>
711f4856 · Zhewen Li · GitHub · 9c5ee91b · 711f4856
Unverified Commit 711f4856 authored Oct 02, 2025 by Zhewen Li Committed by GitHub Oct 02, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

vllm/model_executor/layers/quantization/quark/schemes/quark_w4a4_mxfp4.py ...tor/layers/quantization/quark/schemes/quark_w4a4_mxfp4.py +1 -1

No files found.
--- a/vllm/model_executor/layers/quantization/quark/schemes/quark_w4a4_mxfp4.py
+++ b/vllm/model_executor/layers/quantization/quark/schemes/quark_w4a4_mxfp4.py
@@ -97,7 +97,7 @@ try:
        dispatch_key=current_platform.dispatch_key,
    )

-except ImportError:
+except (ImportError, AttributeError):
    dynamic_mxfp4_quant = gemm_afp4wfp4 = None

 __all__ = ["QuarkW4A4MXFP4"]