tests/v1/engine/test_async_llm.py · 24b0205f58c28e05ac060ec6f0e4defe8e9c32eb · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][Frontend] Coalesce bunched `RequestOutput`s (#12298) · 24b0205f
Nick Hill authored Jan 23, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
24b0205f

test_async_llm.py 4.99 KB