Skip to content

GitLab

Commit 01b0f097 authored by raojy's avatar raojy 💬
Browse files

Update README.md

parent 61a031ec
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
README.md
View file @ 01b0f097
...@@ -243,6 +243,8 @@ CUDA_VISIBLE_DEVICES=0,1,2,3 python inference.py ...@@ -243,6 +243,8 @@ CUDA_VISIBLE_DEVICES=0,1,2,3 python inference.py
#### 单卡推理 #### 单卡推理
``` ```
vllm推理需要确认qwen_vl_utils库，若不存在，请执行
pip install qwen_vl_utils
# 适用于3B/7B模型 # 适用于3B/7B模型
# 启动命令 # 启动命令
vllm serve Qwen/Qwen2.5-VL-3B-Instruct \ vllm serve Qwen/Qwen2.5-VL-3B-Instruct \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment