vllm/engine/async_llm_engine.py · 0fa14907da70f3cbf9eb97d68d760b181a9a25a7 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Frontend] Kill the server on engine death (#6594) · 21b9c49a
Joe Runde authored Aug 08, 2024
```
Signed-off-by: Joe Runde <joe@joerun.de>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
21b9c49a

async_llm_engine.py 40.5 KB