• lvhan028's avatar
    Add profile (#15) · 23c05372
    lvhan028 authored
    * remove constraints on model name
    
    * remove duplicate model converter
    
    * add profile
    
    * get eos and bos from server
    
    * update stop_words
    
    * update sequence_length when the last generated token is eos_id
    
    * fix
    
    * fix
    
    * check-in models
    
    * valicate model_name
    
    * make stop_words as property
    
    * debug profiling
    
    * better stats
    
    * fix assistant reponse
    
    * update profile serving
    
    * update
    
    * update
    23c05372
model.py 2.08 KB