Unverified Commit 955780d3 authored by Henghui Zhu's avatar Henghui Zhu Committed by GitHub
Browse files

add timeout option for deepspeed engine (#20443)

parent d59d5a61
......@@ -1414,7 +1414,7 @@ class TrainingArguments:
raise ImportError("--deepspeed requires deepspeed: `pip install deepspeed`.")
import deepspeed
deepspeed.init_distributed()
deepspeed.init_distributed(timeout=timedelta(seconds=self.ddp_timeout))
# workaround for setups like notebooks where the launcher can't be used,
# but deepspeed requires a dist env.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment