Commit 39e8b493 authored by Michael Goin's avatar Michael Goin Committed by khluu
Browse files

[Bugfix] Register fp8 cutlass_group_gemm as supported for only SM90+SM100 (#33285)


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
(cherry picked from commit 1bd47d6e)
parent f1764434
......@@ -900,6 +900,8 @@ def cutlass_sparse_scaled_mm_supported(cuda_device_capability: int) -> bool:
def cutlass_group_gemm_supported(cuda_device_capability: int) -> bool:
if cuda_device_capability < 90 or cuda_device_capability >= 110:
return False
try:
return torch.ops._C.cutlass_group_gemm_supported(cuda_device_capability)
except AttributeError:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment