• WRH's avatar
    [Feature] Add a torch client (#19) · 009075d8
    WRH authored
    * draft torch client
    
    * deal with space of tokenizer
    
    * support tensor parallel
    
    * fix
    
    * fix
    
    * move folder
    
    * move instruction to readme
    
    * move to torch/
    
    * rename client to chat
    
    * very bad response
    
    * stash
    
    * rename streamer
    
    * support internlm
    
    * change default args
    
    * remove test
    
    * improve instructions
    
    * remove module docstring
    
    * decrease header level of torch model
    009075d8
README.md 6.97 KB