• Matt's avatar
    TF XLA greedy generation (#15786) · cd4c5c90
    Matt authored
    
    
    * First attempt at TF XLA generation
    
    * Fix comments
    
    * Update XLA greedy generate with direct XLA calls
    
    * Support attention mask, prepare_inputs_for_generation no longer hardcoded for greedy
    
    * Handle position_ids correctly
    
    * make xla generate work for non xla case
    
    * force using xla generate
    
    * refactor
    
    * more fixes
    
    * finish cleaning
    
    * finish
    
    * finish
    
    * clean gpt2 tests
    
    * add gpt2 tests
    
    * correct more cases
    
    * up
    
    * finish
    
    * finish
    
    * more fixes
    
    * flake 8 stuff
    
    * final rag fix
    
    * Update src/transformers/models/rag/modeling_tf_rag.py
    
    * finish t5 as well
    
    * finish
    
    * Update src/transformers/generation_utils.py
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    cd4c5c90
test_modeling_tf_gpt2.py 22.4 KB