Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
d976f011
Commit
d976f011
authored
Apr 16, 2020
by
Steven Steinke
Browse files
Update README.md
parent
2e0b3fca
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
d976f011
...
@@ -400,7 +400,7 @@ VALID_DATA="data/RACE/dev/middle \
...
@@ -400,7 +400,7 @@ VALID_DATA="data/RACE/dev/middle \
VOCAB_FILE=bert-vocab.txt
VOCAB_FILE=bert-vocab.txt
PRETRAINED_CHECKPOINT=checkpoints/bert_345m
PRETRAINED_CHECKPOINT=checkpoints/bert_345m
CHECKPOINT_PATH=checkpoints/bert_345m_race
CHECKPOINT_PATH=checkpoints/bert_345m_race
COMMON_TASK_ARGS=
COMMON_TASK_ARGS="--num-layers 24
\
COMMON_TASK_ARGS="--num-layers 24
\
--hidden-size 1024
\
--hidden-size 1024
\
--num-attention-heads 16
\
--num-attention-heads 16
\
--seq-length 512
\
--seq-length 512
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment