Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
"src/vscode:/vscode.git/clone" did not exist on "52bb27cf9a36e83e94cc42781aae2c6ff8320612"
a9b1fc0a80fa7df7c1881b35643163f8dc14e7ad
Switch branch/tag
megatron-lm
megatron
optimizer
distrib_optimizer.py
09 Mar, 2022
3 commits
passing 'model_parallel_group' to clip_grads, count_zeros
· 9546d8f0
Lawrence McAfee
authored
Mar 09, 2022
9546d8f0
encapsulated 'get_model_parallel_group()'; renamed BaseFloat16Optimizer -> MixedPrecisionOptimizer
· 772a4a2d
Lawrence McAfee
authored
Mar 09, 2022
772a4a2d
moved distrib opt to own file.
· 28b63ec7
Lawrence McAfee
authored
Mar 09, 2022
28b63ec7
