Merge branch 'patch-1' of https://github.com/stas00/Megatron-LM into github-pr

4a35d50a · Jared Casper · e1318f0e · 3f755374 · 4a35d50a
Commit 4a35d50a authored Jun 10, 2021 by Jared Casper
Hide whitespace changes
Inline Side-by-side

Showing with 0 additions and 1 deletion

examples/pretrain_t5_distributed_with_mp.sh examples/pretrain_t5_distributed_with_mp.sh +0 -1

No files found.
--- a/examples/pretrain_t5_distributed_with_mp.sh
+++ b/examples/pretrain_t5_distributed_with_mp.sh
@@ -25,7 +25,6 @@ python -m torch.distributed.launch $DISTRIBUTED_ARGS \
       --decoder-seq-length 128 \
       --micro-batch-size 16 \
       --global-batch-size 128 \
-       --seq-length 512 \
       --max-position-embeddings 512 \
       --train-iters 1000000 \
       --lr-decay-iters 1000000 \