Skip to content

GitLab

Unverified Commit 711f4856 authored by Zhewen Li's avatar Zhewen Li Committed by GitHub
Browse files

[Bugfix] Fix import `gemm_afp4wfp4` failure on AMD (#26068) 


Signed-off-by: default avatarzhewenli <zhewenli@meta.com>
parent 9c5ee91b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/layers/quantization/quark/schemes/quark_w4a4_mxfp4.py
View file @ 711f4856
...@@ -97,7 +97,7 @@ try: ...@@ -97,7 +97,7 @@ try:
dispatch_key=current_platform.dispatch_key, dispatch_key=current_platform.dispatch_key,
) )
except ImportError: except (ImportError, AttributeError):
dynamic_mxfp4_quant = gemm_afp4wfp4 = None dynamic_mxfp4_quant = gemm_afp4wfp4 = None
__all__ = ["QuarkW4A4MXFP4"] __all__ = ["QuarkW4A4MXFP4"]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment