Commit 6db110aa authored by laibao's avatar laibao
Browse files

No commit message

No commit message
parent ca84086a
...@@ -150,22 +150,6 @@ curl http://localhost:8000/v1/chat/completions \ ...@@ -150,22 +150,6 @@ curl http://localhost:8000/v1/chat/completions \
``` ```
### OpenAI Chat API和vllm结合使用
```bash
curl http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "Qwen/Qwen1.5-7B-Chat",
"messages": [
{"role": "system", "content": "What is deep learning?"},
{"role": "user", "content": "What is deep learning?"}
]
}'
```
或者使用[examples/openai_chatcompletion_client.py](examples/openai_chatcompletion_client.py)
## result ## result
使用的加速卡:1张 DCU-K100_AI-64G 使用的加速卡:1张 DCU-K100_AI-64G
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment