• Iz Beltagy's avatar
    Longformer (#4352) · 8f1d0471
    Iz Beltagy authored
    * first commit
    
    * bug fixes
    
    * better examples
    
    * undo padding
    
    * remove wrong VOCAB_FILES_NAMES
    
    * License
    
    * make style
    
    * make isort happy
    
    * unit tests
    
    * integration test
    
    * make `black` happy by undoing `isort` changes!!
    
    * lint
    
    * no need for the padding value
    
    * batch_size not bsz
    
    * remove unused type casting
    
    * seqlen not seq_len
    
    * staticmethod
    
    * `bert` selfattention instead of `n2`
    
    * uint8 instead of bool + lints
    
    * pad inputs_embeds using embeddings not a constant
    
    * black
    
    * unit test with padding
    
    * fix unit tests
    
    * remove redundant unit test
    
    * upload model weights
    
    * resolve todo
    
    * simpler _mask_invalid_locations without lru_cache + backward compatible masked_fill_
    
    * increase unittest coverage
    8f1d0471
README.md 40.8 KB