examples/flax/language-modeling/run_clm_flax.py · 69e16abf98c94b8a6d2cf7d60ca36f13e4fbee58 · chenpangpang / transformers

Switch from using sum for flattening lists of lists in group_texts (#14472) · 69e16abf

Nicholas Broad authored Nov 22, 2021



* remove sum for list flattening

* change to chain(*)

* make chain object a list

* delete empty lines

per sgugger's suggestions
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Nicholas Broad <nicholas@nmbroad.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

69e16abf

run_clm_flax.py 28.4 KB

Replace run_clm_flax.py