• Motoki Wu's avatar
    Fix multiple `eos_token_id`s in model.generate(...) (#21461) · 9960506c
    Motoki Wu authored
    * add tests with multiple eos_token_ids
    
    * make math.prod instead of sum
    
    * make fixup
    
    * fix long and also use np.prod since math.prod does not exist <python 3.8
    
    * make fixup
    
    * add prod util
    
    * use prod util instead of np.prod
    
    * make fixup
    
    * previous .long location
    
    * use tensor ops
    
    * remove prod
    
    * remove prod
    
    * update device
    
    * make fixup
    
    * fix none
    9960506c
utils.py 208 KB