src/transformers/data/data_collator.py · 2d506ea4c4980a4cab43c2940d9836ddfd629524 · chenpangpang / transformers

anruijian authored Feb 28, 2023

* fix tf random mask tokens probability

* fix tf random mask tokens probability in collator for langauge modelling

2d506ea4

data_collator.py 75 KB