-
Sylvain Gugger authored
* allow using tokenizer.pad as a collate_fn in pytorch * allow using tokenizer.pad as a collate_fn in pytorch * Add documentation and tests * Make attention mask the right shape * Better test Co-authored-by:Thomas Wolf <thomwolf@users.noreply.github.com>
e9c30314
