• WRH's avatar
    [Refactor] Support multi-session chat (#178) · 4bd0b487
    WRH authored
    * add some dist utils
    
    * add model utils
    
    * add termio and basicstreamer
    
    * typo
    
    * fix world size
    
    * refactor chat and tested llama1
    
    * add internlm adapter and support stoping criteria
    
    * concat with id for internlm
    
    * update docstring
    
    * update and support llama2
    
    * typo
    
    * move docs to docs
    
    * update docstring of session manager
    
    * update docstring
    
    * update docs
    
    * fix accel none in model
    
    * fix and add test for tensor broadcast
    
    * fix session using typing to check type
    
    * add docstrings and comprehensive condition test
    
    * unit test for dist
    
    * fix session
    
    * split unittests of utils
    
    * typo
    
    * update control flow of accel
    
    * move test model
    
    * remove main in unittest
    
    * remove some log
    
    * remove some comments
    4bd0b487
test_dist.py 1.7 KB