Skip to content

GitLab

Commit e070ab35 authored by zhaoying1's avatar zhaoying1
Browse files

Update deepspeed.json

parent 190c4f31
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
simple-pretrain/ptuning/deepspeed.json
View file @ e070ab35
...@@ -10,6 +10,7 @@ ...@@ -10,6 +10,7 @@
"hysteresis": 2, "hysteresis": 2,
"min_loss_scale": 1 "min_loss_scale": 1
}, },
"zero_force_ds_cpu_optimizer": false,
"zero_optimization": { "zero_optimization": {
"stage": 3, "stage": 3,
"offload_optimizer": { "offload_optimizer": {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment