Commit 0d6cbcdb authored by laibao's avatar laibao
Browse files

Update README.md to add usage instructions for vllm serving with GLM4V model,...

Update README.md to add usage instructions for vllm serving with GLM4V model, including command syntax and template details.
parent 34c31a8d
Pipeline #2982 canceled with stages
......@@ -105,7 +105,9 @@ python examples/offline_inference/vision_language.py
`cd examples`
> ```
> vllm serve model_path --trust-remote-code --port 8000 --host 0.0.0.0 --allowed-local-media-path xxxx --hf-overrides '{"architectures": ["GLM4VForCausalLM"]}' --chat-template examples/template_chatml.jinja
> ```
### OpenAI Completions API和vllm结合使用
......@@ -200,7 +202,6 @@ text: What is the content of this image?
<img src="./doc/llava_gradio.png" width="800" height="500"/>
</div>
### 精度
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment