GitLab

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* broken test

* batch parity

* tests pass

* boom boom

* boom boom

* split out bart tokenizer tests

* fix tests

* boom boom

* Fixed dataset bug

* Fix marian

* Undo extra

* Get marian working

* Fix t5 tok tests

* Test passing

* Cleanup

* better assert msg

* require torch

* Fix mbart tests

* undo extra decoder_attn_mask change

* Fix import

* pegasus tokenizer can ignore src_lang kwargs

* unused kwarg test cov

* boom boom

* add todo for pegasus issue

* cover one word translation edge case

* Cleanup

* doc

* Run new isort

* More changes

* Update CI, CONTRIBUTING and benchmarks

Co-authored-by: Jingqing  Zhang <jingqing.zhang15@imperial.ac.uk>

Co-authored-by: Pradhy729 <49659913+Pradhy729@users.noreply.github.com>

* all save_pretrained methods mkdir if not os.path.exists