Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
27f0f0ef
"...text-generation-inference.git" did not exist on "16fadcec5711ff232977b38c74a1c8829af6a63b"
Commit
27f0f0ef
authored
Feb 03, 2021
by
Mostofa Patwary
Browse files
updaded examples/pretrain_ict.sh
parent
2cd5f18a
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
5 deletions
+5
-5
examples/pretrain_ict.sh
examples/pretrain_ict.sh
+5
-5
No files found.
examples/pretrain_ict.sh
View file @
27f0f0ef
...
@@ -22,13 +22,13 @@ python pretrain_ict.py \
...
@@ -22,13 +22,13 @@ python pretrain_ict.py \
--train-iters
100000
\
--train-iters
100000
\
--vocab-file
bert-vocab.txt
\
--vocab-file
bert-vocab.txt
\
--tokenizer-type
BertWordPieceLowerCase
\
--tokenizer-type
BertWordPieceLowerCase
\
--DDP-impl
torch
\
--DDP-impl
torch
\
--bert-load
${
PRETRAINED_BERT_PATH
}
\
--bert-load
${
PRETRAINED_BERT_PATH
}
\
--log-interval
100
\
--log-interval
100
\
--eval-interval
1000
\
--eval-interval
1000
\
--eval-iters
10
\
--eval-iters
10
\
--report-topk-accuracies
1 5 10 20 100
\
--report-topk-accuracies
1 5 10 20 100
\
--retriever-score-scaling
\
--retriever-score-scaling
\
--load
$CHECKPOINT_PATH
\
--load
$CHECKPOINT_PATH
\
--save
$CHECKPOINT_PATH
\
--save
$CHECKPOINT_PATH
\
--data-path
${
TEXT_DATA_PATH
}
\
--data-path
${
TEXT_DATA_PATH
}
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment