update imgs

20076697 · zhuwenwen · 0d96d60e · 20076697 · 20076697
Commit 20076697 authored Jun 12, 2024 by zhuwenwen
Hide whitespace changes
Inline Side-by-side

Showing with 5 additions and 9 deletions

Dockerfile Dockerfile +1 -2

README.md README.md +4 -7

No files found.
--- a/Dockerfile
+++ b/Dockerfile
-FROM image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310
+FROM image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.3.3-dtk24.04-centos7.6-py310-v1
 ENV LANG C.UTF-8
-RUN pip install ray==2.9.1 aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
--- a/README.md
+++ b/README.md
@@ -2,7 +2,7 @@
 * @Author: zhuww
 * @email: zhuww@sugon.com
 * @Date: 2024-04-25 10:38:07
- * @LastEditTime: 2024-05-24 15:47:01
+ * @LastEditTime: 2024-06-12 15:47:01
 -->
 # LLAMA

@@ -28,14 +28,11 @@ LLama是一个基础语言模型的集合,参数范围从7B到65B。在数万亿
 提供[光源](https://www.sourcefind.cn/#/image/dcu/custom)拉取推理的docker镜像：

 ```
-docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310
+docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.3.3-dtk24.04-centos7.6-py310-v1
 # <Image ID>用上面拉取docker镜像的ID替换
 # <Host Path>主机端路径
 # <Container Path>容器映射路径
-docker run -it --name qwen1.5_vllm --privileged --shm-size=64G  --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v /opt/hyhal:/opt/hyhal -v <Host Path>:<Container Path> <Image ID> /bin/bash
-
-# 更新镜像的ray版本和服务依赖
-pip install ray==2.9.1 aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3
+docker run -it --name llama_vllm --privileged --shm-size=64G  --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v /opt/hyhal:/opt/hyhal -v <Host Path>:<Container Path> <Image ID> /bin/bash
 ```

 ### Dockerfile（方法二）
@@ -49,7 +46,7 @@ docker run -it --name llama_vllm --privileged --shm-size=64G  --device=/dev/kfd
 ### Anaconda（方法三）
 ```
 conda create -n llama_vllm python=3.10
-pip install ray==2.9.1 aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3
+pip install aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3
 ```
 关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.hpccube.com/tool/)开发者社区下载安装。
 * DTK驱动：dtk24.04