GitLab

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

* broken test

* batch parity

* tests pass

* boom boom

* boom boom

* split out bart tokenizer tests

* fix tests

* boom boom

* Fixed dataset bug

* Fix marian

* Undo extra

* Get marian working

* Fix t5 tok tests

* Test passing

* Cleanup

* better assert msg

* require torch

* Fix mbart tests

* undo extra decoder_attn_mask change

* Fix import

* pegasus tokenizer can ignore src_lang kwargs

* unused kwarg test cov

* boom boom

* add todo for pegasus issue

* cover one word translation edge case

* Cleanup

* doc

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Document better MT command

* improve multigpu command

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

* add a link to README.md

* Update README.md

* MBART: support summarization tasks

* fix test

* Style

* add tokenizer test

Co-authored-by: Pradhy729 <49659913+Pradhy729@users.noreply.github.com>

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

improve unittests for finetuning, especially w.r.t testing frozen parameters
fix freeze_embeds for T5
add streamlit setup.cfg