Update deepspeed.json

829d3ffa · zhaoying1 · 0938ae70 · 829d3ffa
Commit 829d3ffa authored Nov 08, 2023 by zhaoying1
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

deepspeed.json deepspeed.json +1 -0

No files found.
--- a/deepspeed.json
+++ b/deepspeed.json
 {
    "train_micro_batch_size_per_gpu": "auto",
    "train_batch_size": "auto",
+    "gradient_accumulation_steps": "auto",
    "zero_allow_untested_optimizer": true,
    "fp16": {
      "enabled": "auto",