Skip to content

GitLab

Commit 682619e6 authored by laibao's avatar laibao
Browse files

No commit message 

No commit message
parent a775b714
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
README.md
View file @ 682619e6
...@@ -105,6 +105,8 @@ python examples/llava_example.py ...@@ -105,6 +105,8 @@ python examples/llava_example.py
启动服务： 启动服务：
`cd examples`
```bash ```bash
python -m vllm.entrypoints.openai.api_server --model llava/llava-1.5-7b-hf --image-input-type pixel_values --image-token-id 32000 --image-input-shape 1,3,336,336 --image-feature-size 576 --chat-template template_llava.jinja python -m vllm.entrypoints.openai.api_server --model llava/llava-1.5-7b-hf --image-input-type pixel_values --image-token-id 32000 --image-input-shape 1,3,336,336 --image-feature-size 576 --chat-template template_llava.jinja
...@@ -132,7 +134,6 @@ curl http://localhost:8000/v1/chat/completions \ ...@@ -132,7 +134,6 @@ curl http://localhost:8000/v1/chat/completions \
``` ```
### result ### result
使用的加速卡:单卡K100_AI 模型：[llava-v1.5-7b](http://113.200.138.88:18080/aimodels/llava-v1.5-7b) 使用的加速卡:单卡K100_AI 模型：[llava-v1.5-7b](http://113.200.138.88:18080/aimodels/llava-v1.5-7b)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment