Skip to content

GitLab

"app/vscode:/vscode.git/clone" did not exist on "96624aa41258795817929ec6f1c5d22ab032420a"
Switch branch/tag
Find file BlameHistoryPermalink
  • Sam Shleifer's avatar
    prepare_seq2seq_batch makes labels/ decoder_input_ids made later. (#6654) · 9336086a
    Sam Shleifer authored 
    * broken test

* batch parity

* tests pass

* boom boom

* boom boom

* split out bart tokenizer tests

* fix tests

* boom boom

* Fixed dataset bug

* Fix marian

* Undo extra

* Get marian working

* Fix t5 tok tests

* Test passing

* Cleanup

* better assert msg

* require torch

* Fix mbart tests

* undo extra decoder_attn_mask change

* Fix import

* pegasus tokenizer can ignore src_lang kwargs

* unused kwarg test cov

* boom boom

* add todo for pegasus issue

* cover one word translation edge case

* Cleanup

* doc
    9336086a
test_tokenization_pegasus.py 2.85 KB