tests/test_trainer_utils.py · aaaed56ffcee3433fa57345b70ff68db8e8bde07 · chenpangpang / transformers

Trainer iterable dataset (#11254) · aaaed56f

Sylvain Gugger authored Apr 14, 2021



* IterableDatasetShard

* Test and integration in Trainer

* Update src/transformers/trainer_pt_utils.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Style
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

aaaed56f

test_trainer_utils.py 13.3 KB

Replace test_trainer_utils.py