Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
wuxk1
Megatron-LM
Commits
"vscode:/vscode.git/clone" did not exist on "f7c67f0e81ed9823bed679c8f9a7a05bc068e088"
9546d8f0a7caead8a6369c98f592aa3fcda133a1
Switch branch/tag
megatron-lm
megatron
optimizer
distrib_optimizer.py
09 Mar, 2022
3 commits
passing 'model_parallel_group' to clip_grads, count_zeros
· 9546d8f0
Lawrence McAfee
authored
Mar 09, 2022
9546d8f0
encapsulated 'get_model_parallel_group()'; renamed BaseFloat16Optimizer -> MixedPrecisionOptimizer
· 772a4a2d
Lawrence McAfee
authored
Mar 09, 2022
772a4a2d
moved distrib opt to own file.
· 28b63ec7
Lawrence McAfee
authored
Mar 09, 2022
28b63ec7
