• Arthur's avatar
    [Whisper] Refactor whisper (#21252) · 255257f3
    Arthur authored
    * update whisper logit processor
    
    * add generate for whisper
    
    * remove part of the whisper specific code from pipeline
    
    * update logit processes
    
    * major update
    
    * enforce first timestamp
    
    * update generate
    
    * add more tests
    
    * update new decoding strategy
    
    * Apply suggestions from code review
    
    * update docstring
    
    * fixup
    
    * default config will not have multilingual ar
    
    * update expected tokenizer size, see pull on the hub for whisper-tiny
    255257f3
test_tokenization_whisper.py 13.5 KB