• rooa's avatar
    Add CodeGen model (#17443) · d6b6fb99
    rooa authored
    
    
    * Add CodeGen model
    
    * Add missing key and switch order of super()
    
    * Fix torch.ones init with uint8 instead of bool
    
    * Address comments: copy statements and doc
    
    * update tests
    
    * remove old model parallel
    
    * fix batch gen tests
    
    * fix batch gen test
    
    * update test_gpt2_sample_max_time
    
    * fix codgen test and revert gpt2 test change
    
    * Fix incorrect tie_word_embedding value, typo, URL
    
    * Fix model order in README and styling
    
    * Reorder model list alphabetically
    
    * Set tie_word_embedding to False by default
    
    * Apply suggestions from code review
    
    * Better attn mask name & remove attn masked_bias
    
    * add tokenizer for codegen
    
    * quality
    
    * doc tokenizer
    
    * fix-copies
    
    * add CodeGenTokenizer in converter
    
    * make truncation optional
    
    * add test for truncation
    
    * add copyright
    
    * fix-copies
    
    * fix fast tokenizer decode
    
    * Update src/transformers/models/codegen/tokenization_codegen.py
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * increase vocab_size in tests
    Co-authored-by: default avatarpatil-suraj <surajp815@gmail.com>
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    d6b6fb99
README.md 59.3 KB