Commit a5718531 authored by maxiao1's avatar maxiao1
Browse files

关闭custom_allreduce保持正确性

parent c333f125
......@@ -1539,6 +1539,7 @@ def initialize_model_parallel(
group_name="tp",
pynccl_use_current_stream=duplicate_tp_group,
torch_compile=torch_compile,
use_custom_allreduce = False,
)
if duplicate_tp_group:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment