Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
fastllm
Repository
56215723841565a03ab6f561cd2808262523a9ed
Switch branch/tag
fastllm
tools
scripts
batch_infer_demo.py
Find file
Blame
History
Permalink
1、同步到最新版本；2、增加batch推理接口；3、解决内存泄漏问题；4、修复llama系列流式输出不流畅的问题
· 56215723
zhouxiang
authored
Jan 31, 2024
56215723
batch_infer_demo.py
11.5 KB
Edit
Web IDE
Replace batch_infer_demo.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace batch_infer_demo.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
