• Jianghai's avatar
    [inference] chatglm2 infer demo (#4724) · ce7ade38
    Jianghai authored
    * add chatglm2
    
    * add
    
    * gather needed kernels
    
    * fix some bugs
    
    * finish context forward
    
    * finish context stage
    
    * fix
    
    * add
    
    * pause
    
    * add
    
    * fix bugs
    
    * finish chatglm
    
    * fix bug
    
    * change some logic
    
    * fix bugs
    
    * change some logics
    
    * add
    
    * add
    
    * add
    
    * fix
    
    * fix tests
    
    * fix
    ce7ade38
chatglm2.py 2.25 KB