Skip to content

GitLab

Commit ac854fac authored by zhuwenwen's avatar zhuwenwen
Browse files

add image for K100_AI and Z100L

parent 2a7ebc1a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ ac854fac
...@@ -36,7 +36,7 @@ docker run -it --name llama_vllm --privileged --shm-size=64G --device=/dev/kfd ...@@ -36,7 +36,7 @@ docker run -it --name llama_vllm --privileged --shm-size=64G --device=/dev/kfd
pip install aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com pip install aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
``` ```
`Tips：若在K100/Z100L上使用，需要替换flash_attn，下载链接：https://forum.hpccube.com/thread/515` `Tips：若在K100/Z100L上使用，使用镜像docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.3.3-dtk24.04.1-ubuntu20.4-py310-zk-v1`
### Dockerfile（方法二） ### Dockerfile（方法二）
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment