1. 25 Jun, 2023 1 commit
    • lvhan028's avatar
      Add profile (#15) · 23c05372
      lvhan028 authored
      * remove constraints on model name
      
      * remove duplicate model converter
      
      * add profile
      
      * get eos and bos from server
      
      * update stop_words
      
      * update sequence_length when the last generated token is eos_id
      
      * fix
      
      * fix
      
      * check-in models
      
      * valicate model_name
      
      * make stop_words as property
      
      * debug profiling
      
      * better stats
      
      * fix assistant reponse
      
      * update profile serving
      
      * update
      
      * update
      23c05372