Skip to content

GitLab

"components/src/vscode:/vscode.git/clone" did not exist on "d381e6ff53829f94c097509ac4659597b81aa215"
Unverified Commit 88f1b374 authored by Mohammad Miadh Angkad's avatar Mohammad Miadh Angkad Committed by GitHub
Browse files

[Core] Enable allreduce fusion by default for SM 10.3 (B300/GB300) (#37755) 


Signed-off-by: default avatarMohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
parent 298e5108
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/config/vllm.py
View file @ 88f1b374
...@@ -120,7 +120,7 @@ def enable_allreduce_rms_fusion(cfg: "VllmConfig") -> bool: ...@@ -120,7 +120,7 @@ def enable_allreduce_rms_fusion(cfg: "VllmConfig") -> bool:
and current_platform.is_cuda() and current_platform.is_cuda()
and has_flashinfer() and has_flashinfer()
and ( and (
current_platform.is_device_capability(100) current_platform.is_device_capability_family(100)
or current_platform.is_device_capability(90) or current_platform.is_device_capability(90)
) )
# tp-dp combination broken: # tp-dp combination broken:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment