Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "362c33dff4bb8999e848c8b9e78068ec98cb9a09"
Commit 3f38ecf1 authored by Jared Casper's avatar Jared Casper
Browse files

Merge branch 'readme_fix' into 'main' 

Quick fix of copy/paste error.

See merge request ADLR/megatron-lm!273
parents bba90f79 edb76abe
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
README.md
View file @ 3f38ecf1
...@@ -217,8 +217,8 @@ Very similar to BERT and GPT, the `examples/pretrain_t5.sh` script runs single G ...@@ -217,8 +217,8 @@ Very similar to BERT and GPT, the `examples/pretrain_t5.sh` script runs single G
All of the other arguments remain as they were for BERT and GPT pretraining. All of the other arguments remain as they were for BERT and GPT pretraining.
<pre> <pre>
CHECKPOINT_PATH=checkpoints/bert_345m CHECKPOINT_PATH=checkpoints/t5_345m
VOCAB_FILE=bert-vocab.txt VOCAB_FILE=t5-vocab.txt
DATA_PATH=my-t5_text_sentence DATA_PATH=my-t5_text_sentence
T5_ARGS="--num-layers 24 \ T5_ARGS="--num-layers 24 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment