Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen2-VL_pytorch
Commits
6a231a76
Commit
6a231a76
authored
Dec 27, 2024
by
luopl
Browse files
Update README.md
parent
a5b16b63
Pipeline
#2169
failed with stages
in 0 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
6a231a76
...
...
@@ -227,7 +227,7 @@ print("Chat response:", chat_response)
### 单机多卡
```
python ./inference_vllm/multi_dcu_inference.py
HIP_VISIBLE_DEVICES=0,1,2,3
python ./inference_vllm/multi_dcu_inference.py
```
其中,MODEL_PATH为模型路径,tensor_parallel_size=4为使用卡数,messages为需要输入的内容。
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment