Commit 20f6169f authored by Jared Casper's avatar Jared Casper
Browse files

Merge branch 'patch-2' of https://github.com/kvtoraman/Megatron-LM into github-pr

parents 0747e8e5 0fddb8b7
...@@ -31,7 +31,6 @@ All the cases from 1 billion to 1 trillion parameters achieve more than 43% half ...@@ -31,7 +31,6 @@ All the cases from 1 billion to 1 trillion parameters achieve more than 43% half
* [Data Preprocessing](#data-preprocessing) * [Data Preprocessing](#data-preprocessing)
* [BERT Pretraining](#bert-pretraining) * [BERT Pretraining](#bert-pretraining)
* [GPT Pretraining](#gpt-pretraining) * [GPT Pretraining](#gpt-pretraining)
* [GPT Pretraining](#gpt-pretraining)
* [T5 Pretraining](#t5-pretraining) * [T5 Pretraining](#t5-pretraining)
* [Distributed Pretraining](#distributed-pretraining) * [Distributed Pretraining](#distributed-pretraining)
* [GPT-3 Example](#gpt-3-example) * [GPT-3 Example](#gpt-3-example)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment