examples/lm_finetuning/pregenerate_training_data.py · 784c0ed89a7fcb193530ba042e795b3f6c23d387 · chenpangpang / transformers

Update pregenerate_training_data.py · a3a604ce

jeonsworld authored Jun 10, 2019

apply Whole Word Masking technique.
referred to [create_pretraining_data.py](https://github.com/google-research/bert/blob/master/create_pretraining_data.py)

a3a604ce

pregenerate_training_data.py 15.3 KB

Replace pregenerate_training_data.py