"vscode:/vscode.git/clone" did not exist on "a3dd38d9d3bf70c9bf270ccdb7e83c6710ff296e"
  • Suraj Patil's avatar
    Add m2m100 (#10236) · f6e74a63
    Suraj Patil authored
    * m2m_100
    
    * no layernorm_embedding
    
    * sinusoidal positional embeddings
    
    * update pos embeddings
    
    * add default config values
    
    * tokenizer
    
    * add conversion script
    
    * fix config
    
    * fix pos embed
    
    * remove _float_tensor
    
    * update tokenizer
    
    * update lang codes
    
    * handle lang codes
    
    * fix pos embeds
    
    * fix spm key
    
    * put embedding weights on device
    
    * remove qa and seq classification heads
    
    * fix convert script
    
    * lang codes pn one line
    
    * fix embeds
    
    * fix tokenizer
    
    * fix tokenizer
    
    * add fast tokenizer
    
    * style
    
    * M2M100MT => M2M100
    
    * fix copyright, style
    
    * tokenizer converter
    
    * vocab file
    
    * remove fast tokenizer
    
    * fix embeds
    
    * fix tokenizer
    
    * fix tests
    
    * add tokenizer tests
    
    * add integration test
    
    * quality
    
    * fix model name
    
    * fix test
    
    * doc
    
    * doc
    
    * fix doc
    
    * add copied from statements
    
    * fix tokenizer tests
    
    * apply review suggestions
    
    * fix urls
    
    * fix shift_tokens_right
    
    * apply review suggestions
    
    * fix
    
    * fix doc
    
    * add lang code to id
    
    * remove unused function
    
    * update checkpoint names
    
    * fix copy
    
    * fix tokenizer
    
    * fix checkpoint names
    
    * fix merge issue
    
    * style
    f6e74a63
README.md 30.7 KB