"vscode:/vscode.git/clone" did not exist on "ca66a1674c253b310e1aef94c9766fcf506db187"
Unverified Commit 0b99f5d3 authored by XiaobingZhang's avatar XiaobingZhang Committed by GitHub
Browse files

support flashinfer_fp4 moe for 5090 gpu (#26669)


Signed-off-by: default avatarXiaobingSuper <xiaobingzhangupc@gmail.com>
Signed-off-by: default avatarMichael Goin <mgoin64@gmail.com>
Co-authored-by: default avatarMichael Goin <mgoin64@gmail.com>
parent 1f491aa0
......@@ -32,7 +32,7 @@ def is_flashinfer_fp4_cutlass_moe_available() -> bool:
envs.VLLM_USE_FLASHINFER_MOE_FP4
and has_flashinfer_cutlass_fused_moe()
and current_platform.is_cuda()
and current_platform.is_device_capability(100)
and current_platform.has_device_capability(100)
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment