Skip to content

GitLab

"...model/git@developer.sourcefind.cn:wuxk1/megatron-lm.git" did not exist on "6f3bf9c0d45d79ae1e666f7ab7e8d6848010e34c"
Switch branch/tag
Find file BlameHistoryPermalink
  • Sam Shleifer's avatar
    prepare_seq2seq_batch makes labels/ decoder_input_ids made later. (#6654) · 9336086a
    Sam Shleifer authored 
    * broken test

* batch parity

* tests pass

* boom boom

* boom boom

* split out bart tokenizer tests

* fix tests

* boom boom

* Fixed dataset bug

* Fix marian

* Undo extra

* Get marian working

* Fix t5 tok tests

* Test passing

* Cleanup

* better assert msg

* require torch

* Fix mbart tests

* undo extra decoder_attn_mask change

* Fix import

* pegasus tokenizer can ignore src_lang kwargs

* unused kwarg test cov

* boom boom

* add todo for pegasus issue

* cover one word translation edge case

* Cleanup

* doc
    9336086a
test_tokenization_pegasus.py 2.85 KB