Unverified Commit 88f1b374 authored by Mohammad Miadh Angkad's avatar Mohammad Miadh Angkad Committed by GitHub
Browse files

[Core] Enable allreduce fusion by default for SM 10.3 (B300/GB300) (#37755)


Signed-off-by: default avatarMohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
parent 298e5108
......@@ -120,7 +120,7 @@ def enable_allreduce_rms_fusion(cfg: "VllmConfig") -> bool:
and current_platform.is_cuda()
and has_flashinfer()
and (
current_platform.is_device_capability(100)
current_platform.is_device_capability_family(100)
or current_platform.is_device_capability(90)
)
# tp-dp combination broken:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment