• Yusuke Mori's avatar
    Adding the prepare_seq2seq_batch function to ProphetNet (#8515) · 04d8136b
    Yusuke Mori authored
    * Simply insert T5Tokenizer's prepare_seq2seq_batch
    
    * Update/Add some 'import'
    
    * fix RunTimeError caused by '.view'
    
    * Moves .view related error avoidance from seq2seq_trainer to inside prophetnet
    
    * Update test_tokenization_prophetnet.py
    
    * Format the test code with black
    
    * Re-format the test code
    
    * Update test_tokenization_prophetnet.py
    
    * Add importing require_torch in the test code
    
    * Add importing BatchEncoding in the test code
    
    * Re-format the test code on Colab
    04d8136b
test_tokenization_prophetnet.py 7.79 KB