• Suraj Patil's avatar
    Add mBART-50 (#10154) · 6fc940ed
    Suraj Patil authored
    * add tokenizer for mBART-50
    
    * update tokenizers
    
    * make src_lang and tgt_lang optional
    
    * update tokenizer test
    
    * add setter
    
    * update docs
    
    * update conversion script
    
    * update docs
    
    * update conversion script
    
    * update tokenizer
    
    * update test
    
    * update docs
    
    * doc
    
    * address Sylvain's suggestions
    
    * fix test
    
    * fix formatting
    
    * nits
    6fc940ed
pretrained_models.rst 96.8 KB