Update README.md

Adjusted sequence length and predictions per sequence flags.

Update README.md
Adjusted sequence length and predictions per sequence flags.
ec29c2f4 · Kyle Ziegler · GitHub · 83d7872c · ec29c2f4
Unverified Commit ec29c2f4 authored Dec 14, 2020 by Kyle Ziegler Committed by GitHub Dec 14, 2020
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 2 deletions

official/nlp/bert/README.md official/nlp/bert/README.md +2 -2

No files found.
--- a/official/nlp/bert/README.md
+++ b/official/nlp/bert/README.md
@@ -140,8 +140,8 @@ python models/official/nlp/data/create_pretraining_data.py \
  --output_file=$WORKING_DIR/output/tf_examples.tfrecord \
  --vocab_file=$BERT_DIR/wwm_uncased_L-24_H-1024_A-16/vocab.txt \
  --do_lower_case=True \
-  --max_seq_length=128 \
-  --max_predictions_per_seq=20 \
+  --max_seq_length=512 \
+  --max_predictions_per_seq=76 \
  --masked_lm_prob=0.15 \
  --random_seed=12345 \
  --dupe_factor=5