• NielsRogge's avatar
    Add CANINE (#12024) · 6e685978
    NielsRogge authored
    
    
    * First pass
    
    * More progress
    
    * Add support for local attention
    
    * More improvements
    
    * More improvements
    
    * Conversion script working
    
    * Add CanineTokenizer
    
    * Make style & quality
    
    * First draft of integration test
    
    * Remove decoder test
    
    * Improve tests
    
    * Add documentation
    
    * Mostly docs improvements
    
    * Add CanineTokenizer tests
    
    * Fix most tests on GPU, improve upsampling projection
    
    * Address most comments by @dhgarrette
    
    * Remove decoder logic
    
    * Improve Canine tests, improve docs of CanineConfig
    
    * All tokenizer tests passing
    
    * Make fix-copies and fix tokenizer tests
    
    * Fix test_model_outputs_equivalence test
    
    * Apply suggestions from @sgugger's review
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * Address some more comments
    
    * Add support for hidden_states and attentions of shallow encoders
    
    * Define custom CanineModelOutputWithPooling, tests pass
    
    * First pass
    
    * More progress
    
    * Add support for local attention
    
    * More improvements
    
    * More improvements
    
    * Conversion script working
    
    * Add CanineTokenizer
    
    * Make style & quality
    
    * First draft of integration test
    
    * Remove decoder test
    
    * Improve tests
    
    * Add documentation
    
    * Mostly docs improvements
    
    * Add CanineTokenizer tests
    
    * Fix most tests on GPU, improve upsampling projection
    
    * Address most comments by @dhgarrette
    
    * Remove decoder logic
    
    * Improve Canine tests, improve docs of CanineConfig
    
    * All tokenizer tests passing
    
    * Make fix-copies and fix tokenizer tests
    
    * Fix test_model_outputs_equivalence test
    
    * Apply suggestions from @sgugger's review
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * Address some more comments
    
    * Make conversion script work for Canine-c too
    
    * Fix tokenizer tests
    
    * Remove file
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    6e685978
README.md 37.5 KB