Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen_lmdeploy
Commits
6dbf6277
Commit
6dbf6277
authored
Jan 31, 2024
by
zhouxiang
Browse files
更新lmdeploy版本到0.1.0
parent
fad9754d
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
4 additions
and
6 deletions
+4
-6
.gitmodules
.gitmodules
+1
-1
README.md
README.md
+2
-4
lmdeploy
lmdeploy
+1
-1
No files found.
.gitmodules
View file @
6dbf6277
[submodule "lmdeploy"]
path = lmdeploy
url = http://developer.hpccube.com/codes/aicomponent/lmdeploy.git
branch = dtk23.10-v0.0.13-qwen
\ No newline at end of file
branch = dtk23.10-v0.1.0
\ No newline at end of file
README.md
View file @
6dbf6277
...
...
@@ -23,14 +23,14 @@ Qwen的构建采用了类似LLaMA的架构。与标准transformer的主要差异
## 环境配置
提供
[
光源
](
https://www.sourcefind.cn/#/service-details
)
拉取推理的docker镜像:
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy
0
.0
.13_
dtk23.
04_
torch1.13
_
py38
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy
1
.0
-
dtk23.
10-
torch1.13
-
py38
-latest
# <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径
# <Container Path>容器映射路径
docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path> <Image ID> /bin/bash
```
镜像版本依赖:
*
DTK驱动:dtk23.0
4
*
DTK驱动:dtk23.
1
0
*
Pytorch: 1.13
*
python: python3.8
...
...
@@ -41,8 +41,6 @@ docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri
### 源码编译安装
```
# 若使用光源的镜像,可以不用源码编译,镜像里面安装好了lmdeploy,可跳过源码编译安装
# 若需要使用的是qwen72b模型,则必须重新使用源码编译安装lmdeploy
# 编译安装前先卸载原镜像中的lmdeploy
pip uninstall lmdeploy
# 获取源码,编译并安装
git clone http://developer.hpccube.com/codes/modelzoo/Qwen_lmdeploy.git
...
...
lmdeploy
@
d033914f
Subproject commit
206219aad30d88ad510287218f4fd17e22845
14
2
Subproject commit
d033914f0a2ba0724f7b08905bd1f18a0afe18
14
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment