Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Lmdeploy
Merge requests
!3
Merged
Created
Jul 01, 2024
by
gaoqiong
@gaoqiong
Maintainer
Options
添加lmdeploy AWQ量化推理支持模块
Overview
0
Commits
3
Changes
36
添加llama系列以及qwen系列模型AWQ量化推理模块,支持多卡量化推理,仅支持KM_AI卡,其他卡类型该模块暂不支持。