• Ahmed Elnaggar's avatar
    Add T5 Encoder for Feature Extraction (#8717) · 40ecaf0c
    Ahmed Elnaggar authored
    
    
    * Add T5 Encoder class for feature extraction
    
    * fix T5 encoder add_start_docstrings indent
    
    * update init with T5 encoder
    
    * update init with TFT5ModelEncoder
    
    * remove TFT5ModelEncoder
    
    * change T5ModelEncoder order in init
    
    * add T5ModelEncoder to transformers init
    
    * clean T5ModelEncoder
    
    * update init with TFT5ModelEncoder
    
    * add TFModelEncoder for Tensorflow
    
    * update init with TFT5ModelEncoder
    
    * Update src/transformers/models/t5/modeling_t5.py
    
    change output from Seq2SeqModelOutput to BaseModelOutput
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * remove encoder_outputs
    
    1. remove encoder_outputs from the function call.
    2. remove the encoder_outputs If statement.
    3. remove isinstance from return_dict.
    
    * Authorize missing decoder keys
    
    * remove unnecessary input parameters
    
    remove pask_key_values and use_cache
    
    * remove use_cache
    
    remove use_cache from the forward method
    
    * add doctoring for T5 encoder
    
    add doctoring for T5 encoder with T5_ENCODER_INPUTS_DOCSTRING
    
    * change return_dict to dot access
    
    * add T5_ENCODER_INPUTS_DOCSTRING for TF T5
    
    * change TFT5Encoder output type to BaseModelOutput
    
    * remove unnecessary parameters for TFT5Encoder
    
    * remove unnecessary if statement
    
    * add import BaseModelOutput
    
    * fix BaseModelOutput typo to TFBaseModelOutput
    
    * update T5 doc with T5ModelEncoder
    
    * add T5ModelEncoder to tests
    
    * finish pytorch
    
    * finish docs and mt5
    
    * add mtf to init
    
    * fix init
    
    * remove n_positions
    
    * finish PR
    
    * Update src/transformers/models/mt5/modeling_mt5.py
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * Update src/transformers/models/t5/modeling_t5.py
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * Update src/transformers/models/t5/modeling_tf_t5.py
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * Update src/transformers/models/mt5/modeling_tf_mt5.py
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * make style
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    40ecaf0c
test_modeling_tf_t5.py 42.2 KB