Commits · 0d47bf3bf40edfe9fcfd7e5cd909388497535bc5 · OpenDAS / vllm_cscc

18 Sep, 2024 2 commits

[Bugfix] add `dead_error` property to engine client (#8574) · 0d47bf3b
Joe Runde authored Sep 18, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
0d47bf3b

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8