Skip to content

GitLab

Commit 360fb6b7 authored by Mostofa Patwary's avatar Mostofa Patwary
Browse files

minor change

parent 4bea4e76
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
megatron/arguments.py
View file @ 360fb6b7
...@@ -601,7 +601,7 @@ def _add_data_args(parser): ...@@ -601,7 +601,7 @@ def _add_data_args(parser):
help="Maximum decoder sequence length to process.") help="Maximum decoder sequence length to process.")
group.add_argument('--retriever-seq-length', type=int, default=256, group.add_argument('--retriever-seq-length', type=int, default=256,
help='Maximum sequence length for the biencoder model ' help='Maximum sequence length for the biencoder model '
' for retriever') ' for retriever')
group.add_argument('--mask-prob', type=float, default=0.15, group.add_argument('--mask-prob', type=float, default=0.15,
help='Probability of replacing a token with mask.') help='Probability of replacing a token with mask.')
group.add_argument('--short-seq-prob', type=float, default=0.1, group.add_argument('--short-seq-prob', type=float, default=0.1,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment