Skip to content

GitLab

"src/diffusers/models/autoencoders/autoencoder_kl.py" did not exist on "703307efcc49fbc3f1362344dc5d577e4c4595c8"
Commit 6dbf6277 authored by zhouxiang's avatar zhouxiang
Browse files

更新lmdeploy版本到0.1.0

parent fad9754d
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 6 deletions
.gitmodules
View file @ 6dbf6277
[submodule "lmdeploy"] [submodule "lmdeploy"]
path = lmdeploy path = lmdeploy
url = http://developer.hpccube.com/codes/aicomponent/lmdeploy.git url = http://developer.hpccube.com/codes/aicomponent/lmdeploy.git
branch = dtk23.10-v0.0.13-qwen branch = dtk23.10-v0.1.0
\ No newline at end of file \ No newline at end of file
README.md
View file @ 6dbf6277
...@@ -23,14 +23,14 @@ Qwen的构建采用了类似LLaMA的架构。与标准transformer的主要差异 ...@@ -23,14 +23,14 @@ Qwen的构建采用了类似LLaMA的架构。与标准transformer的主要差异
## 环境配置 ## 环境配置
提供[光源](https://www.sourcefind.cn/#/service-details)拉取推理的docker镜像： 提供[光源](https://www.sourcefind.cn/#/service-details)拉取推理的docker镜像：
``` ```
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy0.0.13_dtk23.04_torch1.13_py38 docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy1.0-dtk23.10-torch1.13-py38-latest
# <Image ID>用上面拉取docker镜像的ID替换 # <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径 # <Host Path>主机端路径
# <Container Path>容器映射路径 # <Container Path>容器映射路径
docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path> <Image ID> /bin/bash docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path> <Image ID> /bin/bash
``` ```
镜像版本依赖： 镜像版本依赖：
* DTK驱动：dtk23.04 * DTK驱动：dtk23.10
* Pytorch: 1.13 * Pytorch: 1.13
* python: python3.8 * python: python3.8
...@@ -41,8 +41,6 @@ docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri ...@@ -41,8 +41,6 @@ docker run -it --name qwen --shm-size=1024G --device=/dev/kfd --device=/dev/dri
### 源码编译安装 ### 源码编译安装
``` ```
# 若使用光源的镜像，可以不用源码编译，镜像里面安装好了lmdeploy，可跳过源码编译安装 # 若使用光源的镜像，可以不用源码编译，镜像里面安装好了lmdeploy，可跳过源码编译安装
# 若需要使用的是qwen72b模型，则必须重新使用源码编译安装lmdeploy
# 编译安装前先卸载原镜像中的lmdeploy
pip uninstall lmdeploy pip uninstall lmdeploy
# 获取源码，编译并安装 # 获取源码，编译并安装
git clone http://developer.hpccube.com/codes/modelzoo/Qwen_lmdeploy.git git clone http://developer.hpccube.com/codes/modelzoo/Qwen_lmdeploy.git
......
lmdeploy @ d033914f
Subproject commit 206219aad30d88ad510287218f4fd17e22845142 Subproject commit d033914f0a2ba0724f7b08905bd1f18a0afe1814
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment