Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
9546d8f0a7caead8a6369c98f592aa3fcda133a1
Switch branch/tag
megatron-lm
megatron
optimizer
distrib_optimizer.py
09 Mar, 2022
3 commits
passing 'model_parallel_group' to clip_grads, count_zeros
· 9546d8f0
Lawrence McAfee
authored
Mar 09, 2022
9546d8f0
encapsulated 'get_model_parallel_group()'; renamed BaseFloat16Optimizer -> MixedPrecisionOptimizer
· 772a4a2d
Lawrence McAfee
authored
Mar 09, 2022
772a4a2d
moved distrib opt to own file.
· 28b63ec7
Lawrence McAfee
authored
Mar 09, 2022
28b63ec7
