• Lyu Han's avatar
    Support InternLM 20B (#440) · df7955de
    Lyu Han authored
    
    
    * better profiler
    
    * wait for releasing mem
    
    * remove fire
    
    * remove support for multiple model benchmark
    
    * comments
    
    * support actual seqlen
    
    * change chat template
    
    * update
    
    * fix ut
    
    * int->size_t
    
    * output more details
    
    * correct tp
    
    * rollback
    
    * update
    
    * update readme
    
    * add 'internlm-chat' as the default tag for internlm chat models
    
    * rollback tokenizer
    
    ---------
    Co-authored-by: default avatarAllentDan <AllentDan@yeah.net>
    Co-authored-by: default avatargrimoire <yaoqian@pjlab.org.cn>
    df7955de
test_model.py 7.55 KB