tools/scripts/baichuan2_2flm.py · 56215723841565a03ab6f561cd2808262523a9ed · OpenDAS / fastllm · GitLab

Find file Blame History Permalink

1、同步到最新版本；2、增加batch推理接口；3、解决内存泄漏问题；4、修复llama系列流式输出不流畅的问题 · 56215723
zhouxiang authored Jan 31, 2024

56215723

baichuan2_2flm.py 1017 Bytes