Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
laibao
Qwen2.5_vllm
Commits
8d5187cb
Commit
8d5187cb
authored
Sep 19, 2024
by
zhuwenwen
Browse files
add image for K100_AI and Z100L
parent
5a160e1c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
8d5187cb
...
...
@@ -35,7 +35,7 @@ docker run -it --name qwen1.5_vllm --privileged --shm-size=64G --device=/dev/kf
pip install aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
```
`Tips:若在K100/Z100L上使用,
需要替换flash_attn,下载链接:https://forum.hpccube.com/thread/515
`
`Tips:若在K100/Z100L上使用,
使用镜像docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.3.3-dtk24.04.1-ubuntu20.4-py310-zk-v1
`
### Dockerfile(方法二)
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment