Skip to content

GitLab

Commit 1b42a6b8 authored by zhaoying1's avatar zhaoying1
Browse files

Update deepspeed.json

parent 4321d0c8
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
ptuning/deepspeed.json
View file @ 1b42a6b8
...@@ -29,6 +29,7 @@ ...@@ -29,6 +29,7 @@
"device": "cpu", "device": "cpu",
"pin_memory": true "pin_memory": true
}, },
"stage3_gather_16bit_weights_on_model_save": true,
"allgather_partitions": true, "allgather_partitions": true,
"allgather_bucket_size": 5e8, "allgather_bucket_size": 5e8,
"overlap_comm": false, "overlap_comm": false,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment