• zhiheng-huang's avatar
    Support various BERT relative position embeddings (2nd) (#8276) · 2c83b3c3
    zhiheng-huang authored
    
    
    * Support BERT relative position embeddings
    
    * Fix typo in README.md
    
    * Address review comment
    
    * Fix failing tests
    
    * [tiny] Fix style_doc.py check by adding an empty line to configuration_bert.py
    
    * make fix copies
    
    * fix configs of electra and albert and fix longformer
    
    * remove copy statement from longformer
    
    * fix albert
    
    * fix electra
    
    * Add bert variants forward tests for various position embeddings
    
    * [tiny] Fix style for test_modeling_bert.py
    
    * improve docstring
    
    * [tiny] improve docstring and remove unnecessary dependency
    
    * [tiny] Remove unused import
    
    * re-add to ALBERT
    
    * make embeddings work for ALBERT
    
    * add test for albert
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    2c83b3c3
test_modeling_roberta.py 17.8 KB