Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
dcec1db7
Commit
dcec1db7
authored
Apr 29, 2025
by
zhuwenwen
Browse files
update README.md
parent
dcb5624a
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
2 deletions
+4
-2
README.md
README.md
+4
-2
No files found.
README.md
View file @
dcec1db7
...
...
@@ -13,6 +13,8 @@ vLLM是一个快速且易于使用的LLM推理和服务库,使用PageAttention
| LlamaForCausalLM | Llama 3.1,Llama 3,Llama 2,Llama,Yi,Codellama,DeepSeek-R1-Distill-Llama | Yes | Yes | Yes |
| QWenLMHeadModel | QWen,Qwen-VL | Yes | Yes | Yes |
| Qwen2ForCausalLM | QWen2,QWen1.5,CodeQwen1.5,DeepSeek-R1-Distill-Qwen,gte_Qwen2-1.5B-instruct | Yes | Yes | Yes |
| Qwen3ForCausalLM | QWen3 | Yes | - | - |
| Qwen3MoeForCausalLM | QWen3MoE | Yes | - | - |
| ChatGLMModel | glm-4v-9b,chatglm3,chatglm2 | Yes | No | Yes |
| DeepseekForCausalLM | Deepseek | Yes | No | - |
| DeepseekV2ForCausalLM | DeepSeek-V2 | Yes | No | - |
...
...
@@ -67,12 +69,12 @@ pip install -r requirements/rocm.txt
-
提供2种源码编译方式(进入vllm目录):
```
1. 编译whl包并安装
VLLM_INSTALL_PUNICA_KERNELS=1
python setup.py bdist_wheel
python setup.py bdist_wheel
cd dist
pip install vllm*
2. 源码编译安装
VLLM_INSTALL_PUNICA_KERNELS=1
python3 setup.py install (若调试,可使用VLLM_INSTALL_PUNICA_KERNELS=1 python3 setup.py develop)
python3 setup.py install (若调试,可使用VLLM_INSTALL_PUNICA_KERNELS=1 python3 setup.py develop)
```
若需要添加git号,设置环境变量: export ADD_GIT_VERSION=1
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment