"vscode:/vscode.git/clone" did not exist on "b0ccfc565ac263b4097175b3ba33ad1d5dc5df8a"
Unverified Commit 487e5c51 authored by Jiangyun Zhu's avatar Jiangyun Zhu Committed by GitHub
Browse files

[Bugfix] disable allreduce_rms_fusion by default when pp size > 1 (#35424)


Signed-off-by: default avatarzjy0516 <riverclouds.zhu@qq.com>
parent 1a8c7167
......@@ -126,6 +126,9 @@ def enable_allreduce_rms_fusion(cfg: "VllmConfig") -> bool:
# tp-dp combination broken:
# https://github.com/vllm-project/vllm/issues/34458
and cfg.parallel_config.data_parallel_size == 1
# tp-pp combination broken:
# https://github.com/vllm-project/vllm/issues/35426
and cfg.parallel_config.pipeline_parallel_size == 1
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment