1. 07 Aug, 2023 1 commit
    • WRH's avatar
      [Refactor] Support multi-session chat (#178) · 4bd0b487
      WRH authored
      * add some dist utils
      
      * add model utils
      
      * add termio and basicstreamer
      
      * typo
      
      * fix world size
      
      * refactor chat and tested llama1
      
      * add internlm adapter and support stoping criteria
      
      * concat with id for internlm
      
      * update docstring
      
      * update and support llama2
      
      * typo
      
      * move docs to docs
      
      * update docstring of session manager
      
      * update docstring
      
      * update docs
      
      * fix accel none in model
      
      * fix and add test for tensor broadcast
      
      * fix session using typing to check type
      
      * add docstrings and comprehensive condition test
      
      * unit test for dist
      
      * fix session
      
      * split unittests of utils
      
      * typo
      
      * update control flow of accel
      
      * move test model
      
      * remove main in unittest
      
      * remove some log
      
      * remove some comments
      4bd0b487