• Deniz's avatar
    tf add resize_token_embeddings method (#4351) · 32e94cff
    Deniz authored
    
    
    * resize token embeddings
    
    * add tokens
    
    * add tokens
    
    * add tokens
    
    * add t5 token method
    
    * add t5 token method
    
    * add t5 token method
    
    * typo
    
    * debugging input
    
    * debugging input
    
    * debug
    
    * debug
    
    * debug
    
    * trying to set embedding tokens properly
    
    * set embeddings for generation head too
    
    * set embeddings for generation head too
    
    * debugging
    
    * debugging
    
    * enable generation
    
    * add base method
    
    * add base method
    
    * add base method
    
    * return logits in the main call
    
    * reverting to generation
    
    * revert back
    
    * set embeddings for the bert main layer
    
    * description
    
    * fix conflicts
    
    * logging
    
    * set base model as self
    
    * refactor
    
    * tf_bert add method
    
    * tf_bert add method
    
    * tf_bert add method
    
    * tf_bert add method
    
    * tf_bert add method
    
    * tf_bert add method
    
    * tf_bert add method
    
    * tf_bert add method
    
    * v0
    
    * v0
    
    * finalize
    
    * final
    
    * black
    
    * add tests
    
    * revert back the emb call
    
    * comments
    
    * comments
    
    * add the second test
    
    * add vocab size condig
    
    * add tf models
    
    * add tf models. add common tests
    
    * remove model specific embedding tests
    
    * stylish
    
    * remove files
    
    * stylez
    
    * Update src/transformers/modeling_tf_transfo_xl.py
    
    change the error.
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    
    * adding unchanged weight test
    Co-authored-by: default avatarLysandre Debut <lysandre@huggingface.co>
    32e94cff
test_modeling_tf_common.py 31.4 KB