Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
deepspeed
Commits
7b07e123
Unverified
Commit
7b07e123
authored
Jan 15, 2021
by
Stas Bekman
Committed by
GitHub
Jan 15, 2021
Browse files
doc fix (#651)
Co-authored-by:
Jeff Rasley
<
jerasley@microsoft.com
>
parent
e729a3fd
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
docs/_pages/config-json.md
docs/_pages/config-json.md
+2
-1
No files found.
docs/_pages/config-json.md
View file @
7b07e123
...
...
@@ -54,6 +54,7 @@ title: "DeepSpeed Configuration JSON"
}
```
The Adam optimizer also supports the following two params keys/values in addition to the standard parameters from
[
torch.optim.Adam
](
https://pytorch.org/docs/stable/_modules/torch/optim/adam.html#Adam
)
:
| "params" key | Description | Default |
| ------------- | --------------------------------------------------------------------------- | --------|
| torch
\_
adam | Use torch's implementation of adam instead of our fused adam implementation | false |
...
...
@@ -97,7 +98,7 @@ Example of ***scheduler***
"warmup_max_lr"
:
0.001
,
"warmup_num_steps"
:
1000
}
}
}
```
### Communication options
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment