• Sam Shleifer's avatar
    prepare_seq2seq_batch makes labels/ decoder_input_ids made later. (#6654) · 9336086a
    Sam Shleifer authored
    * broken test
    
    * batch parity
    
    * tests pass
    
    * boom boom
    
    * boom boom
    
    * split out bart tokenizer tests
    
    * fix tests
    
    * boom boom
    
    * Fixed dataset bug
    
    * Fix marian
    
    * Undo extra
    
    * Get marian working
    
    * Fix t5 tok tests
    
    * Test passing
    
    * Cleanup
    
    * better assert msg
    
    * require torch
    
    * Fix mbart tests
    
    * undo extra decoder_attn_mask change
    
    * Fix import
    
    * pegasus tokenizer can ignore src_lang kwargs
    
    * unused kwarg test cov
    
    * boom boom
    
    * add todo for pegasus issue
    
    * cover one word translation edge case
    
    * Cleanup
    
    * doc
    9336086a
test_seq2seq_examples.py 19.1 KB