Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
laibao
Qwen2.5_vllm
Commits
753923c5
Commit
753923c5
authored
Oct 12, 2024
by
laibao
Browse files
readme
parent
25144e8b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
README.md
README.md
+2
-2
No files found.
README.md
View file @
753923c5
...
...
@@ -21,7 +21,7 @@ Qwen2.5是阿里云开源的最新一代大型语言模型,标志着Qwen系列
## 算法原理
和Qwen一样,Qwen
1
.5仍然是一个decoder-only的transformer模型,使用SwiGLU激活函数、RoPE、多头注意力机制等。
和Qwen一样,Qwen
2
.5仍然是一个decoder-only的transformer模型,使用SwiGLU激活函数、RoPE、多头注意力机制等。
<div
align=
center
>
<img
src=
"./doc/qwen1.5.png"
/>
...
...
@@ -49,7 +49,7 @@ docker run -it --name qwen2.5_vllm --privileged --shm-size=64G --device=/dev/kf
# <Host Path>主机端路径
# <Container Path>容器映射路径
docker build -t qwen2.5:latest .
docker run -it --name qwen2.5_vllm --privileged --shm-size=64G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v /opt/hyhal:/opt/hyhal:ro -v <Host Path>:<Container Path> qwen
1
.5:latest /bin/bash
docker run -it --name qwen2.5_vllm --privileged --shm-size=64G --device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v /opt/hyhal:/opt/hyhal:ro -v <Host Path>:<Container Path> qwen
2
.5:latest /bin/bash
```
### Anaconda(方法三)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment