Skip to content

GitLab

Unverified Commit 7b5fc719 authored by Cheng Wan's avatar Cheng Wan Committed by GitHub
Browse files

fix SUPPORT_CUTLASS_BLOCK_FP8 flag (#4640)

parent ad4e58bf
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/layers/quantization/fp8_utils.py
View file @ 7b5fc719
...@@ -82,7 +82,7 @@ def normalize_e4m3fn_to_e4m3fnuz( ...@@ -82,7 +82,7 @@ def normalize_e4m3fn_to_e4m3fnuz(
def cutlass_block_fp8_supported() -> bool: def cutlass_block_fp8_supported() -> bool:
if get_bool_env_var("SUPPORT_CUTLASS_BLOCK_FP8"): if not get_bool_env_var("SUPPORT_CUTLASS_BLOCK_FP8"):
return False return False
if _is_cuda: if _is_cuda:
major, minor = torch.cuda.get_device_capability() major, minor = torch.cuda.get_device_capability()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment