Skip to content

GitLab

Unverified Commit 6b2b8bf0 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: blackwell dsv3 fp8 issue temporary solution (#9530)

parent 4edbe0d5
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
python/sglang/srt/layers/quantization/deep_gemm_wrapper/configurer.py
View file @ 6b2b8bf0
...@@ -7,7 +7,8 @@ logger = logging.getLogger(__name__) ...@@ -7,7 +7,8 @@ logger = logging.getLogger(__name__)
def _compute_enable_deep_gemm(): def _compute_enable_deep_gemm():
sm_version = get_device_sm() sm_version = get_device_sm()
if sm_version < 90: # TODO fix blackwell fp8
if sm_version != 90:
return False return False
try: try:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment