Skip to content

GitLab

Commit ffb20103 authored by zhuwenwen's avatar zhuwenwen
Browse files

update imgs

parent b51171e8
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 8 deletions
Dockerfile
View file @ ffb20103
FROM image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310 FROM image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.3.3-dtk24.04-centos7.6-py310-v1
ENV LANG C.UTF-8 ENV LANG C.UTF-8
RUN pip install ray==2.9.1 tiktoken aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com \ No newline at end of file
\ No newline at end of file
README.md
View file @ ffb20103
...@@ -27,14 +27,11 @@ Qwen1.5是阿里云开源大型语言模型系列，是Qwen2.0的beta版本。 ...@@ -27,14 +27,11 @@ Qwen1.5是阿里云开源大型语言模型系列，是Qwen2.0的beta版本。
提供[光源](https://www.sourcefind.cn/#/image/dcu/custom)拉取推理的docker镜像： 提供[光源](https://www.sourcefind.cn/#/image/dcu/custom)拉取推理的docker镜像：
``` ```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310 docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.3.3-dtk24.04-centos7.6-py310-v1
# <Image ID>用上面拉取docker镜像的ID替换 # <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径 # <Host Path>主机端路径
# <Container Path>容器映射路径 # <Container Path>容器映射路径
docker run -it --name qwen1.5_vllm --privileged --shm-size=64G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v /opt/hyhal:/opt/hyhal -v <Host Path>:<Container Path> <Image ID> /bin/bash docker run -it --name qwen1.5_vllm --privileged --shm-size=64G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v /opt/hyhal:/opt/hyhal -v <Host Path>:<Container Path> <Image ID> /bin/bash
# 更新镜像的ray版本和服务依赖
pip install ray==2.9.1 tiktoken aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3
``` ```
### Dockerfile（方法二） ### Dockerfile（方法二）
...@@ -48,7 +45,7 @@ docker run -it --name qwen1.5_vllm --privileged --shm-size=64G --device=/dev/kf ...@@ -48,7 +45,7 @@ docker run -it --name qwen1.5_vllm --privileged --shm-size=64G --device=/dev/kf
### Anaconda（方法三） ### Anaconda（方法三）
``` ```
conda create -n qwen1.5_vllm python=3.10 conda create -n qwen1.5_vllm python=3.10
pip install ray==2.9.1 tiktoken aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3 pip install aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3
``` ```
关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.hpccube.com/tool/)开发者社区下载安装。 关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.hpccube.com/tool/)开发者社区下载安装。
* DTK驱动：dtk24.04 * DTK驱动：dtk24.04
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment