Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
wuxk1
Megatron-LM
Repository
"examples/pretrain_gpt2_distributed_with_mp.sh" did not exist on "cd4822f19aa20d592480356273d7b4b65bd745e0"
270d6412bfe0b96af13ef861e47a3e8b45dfecee
Switch branch/tag
megatron-lm
megatron
mpu
random.py
Find file
Blame
History
Permalink
loss matches; memory savings for multi-node (tested n3, n16)
· 270d6412
Lawrence McAfee
authored
Jan 10, 2022
270d6412
random.py
15.1 KB
Edit
Web IDE
Replace random.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace random.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
