examples/online_serving/batched_chat_completions.py · 2908094567e7ebbf59b0f3b9be036d8929901971 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) · 29080945
Matej Rojec authored Mar 26, 2026
```
Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>
```
29080945

batched_chat_completions.py 6.61 KB