Skip to content

GitLab

Commit 79955878 authored by zhaoying1's avatar zhaoying1
Browse files

Update deepspeed.json

parent 3a3f5683
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
finetune_chatmodel_demo/configs/deepspeed.json
View file @ 79955878
...@@ -13,6 +13,7 @@ ...@@ -13,6 +13,7 @@
}, },
"zero_optimization": { "zero_optimization": {
"stage": 3, "stage": 3,
"stage3_gather_16bit_weights_on_model_save": true,
"allgather_partitions": true, "allgather_partitions": true,
"allgather_bucket_size": 5e8, "allgather_bucket_size": 5e8,
"overlap_comm": false, "overlap_comm": false,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment