Commit 6dbf6277 authored by zhouxiang's avatar zhouxiang
Browse files

更新lmdeploy版本到0.1.0

parent fad9754d
[submodule "lmdeploy"]
path = lmdeploy
url = http://developer.hpccube.com/codes/aicomponent/lmdeploy.git
branch = dtk23.10-v0.0.13-qwen
\ No newline at end of file
branch = dtk23.10-v0.1.0
\ No newline at end of file
......@@ -23,14 +23,14 @@ Qwen的构建采用了类似LLaMA的架构。与标准transformer的主要差异
## 环境配置
提供[光源](https://www.sourcefind.cn/#/service-details)拉取推理的docker镜像:
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy0.0.13_dtk23.04_torch1.13_py38
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy1.0-dtk23.10-torch1.13-py38-latest
# <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径
# <Container Path>容器映射路径
docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path> <Image ID> /bin/bash
```
镜像版本依赖:
* DTK驱动:dtk23.04
* DTK驱动:dtk23.10
* Pytorch: 1.13
* python: python3.8
......@@ -41,8 +41,6 @@ docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri
### 源码编译安装
```
# 若使用光源的镜像,可以不用源码编译,镜像里面安装好了lmdeploy,可跳过源码编译安装
# 若需要使用的是qwen72b模型,则必须重新使用源码编译安装lmdeploy
# 编译安装前先卸载原镜像中的lmdeploy
pip uninstall lmdeploy
# 获取源码,编译并安装
git clone http://developer.hpccube.com/codes/modelzoo/Qwen_lmdeploy.git
......
lmdeploy @ d033914f
Subproject commit 206219aad30d88ad510287218f4fd17e22845142
Subproject commit d033914f0a2ba0724f7b08905bd1f18a0afe1814
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment