Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
20f6169f
Commit
20f6169f
authored
Jan 28, 2022
by
Jared Casper
Browse files
Merge branch 'patch-2' of
https://github.com/kvtoraman/Megatron-LM
into github-pr
parents
0747e8e5
0fddb8b7
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
1 deletion
+0
-1
README.md
README.md
+0
-1
No files found.
README.md
View file @
20f6169f
...
...
@@ -31,7 +31,6 @@ All the cases from 1 billion to 1 trillion parameters achieve more than 43% half
*
[
Data Preprocessing
](
#data-preprocessing
)
*
[
BERT Pretraining
](
#bert-pretraining
)
*
[
GPT Pretraining
](
#gpt-pretraining
)
*
[
GPT Pretraining
](
#gpt-pretraining
)
*
[
T5 Pretraining
](
#t5-pretraining
)
*
[
Distributed Pretraining
](
#distributed-pretraining
)
*
[
GPT-3 Example
](
#gpt-3-example
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment