Skip to content

GitLab

Unverified Commit 2343d8df authored by JieXin Liang's avatar JieXin Liang Committed by GitHub
Browse files

[fix] force use deepgemm in compile_deep_gemm (#5618)

parent 92bb64bc
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
python/sglang/compile_deep_gemm.py
View file @ 2343d8df
...@@ -28,6 +28,8 @@ multiprocessing.set_start_method("spawn", force=True) ...@@ -28,6 +28,8 @@ multiprocessing.set_start_method("spawn", force=True)
# Reduce warning # Reduce warning
os.environ["SGL_IN_DEEP_GEMM_PRE_COMPILE_STAGE"] = "1" os.environ["SGL_IN_DEEP_GEMM_PRE_COMPILE_STAGE"] = "1"
# Force enable deep gemm
os.environ["SGL_ENABLE_JIT_DEEPGEMM"] = "1"
@dataclasses.dataclass @dataclasses.dataclass
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment