vllm/engine/llm_engine.py · 0229c386c541a293f18a9ffe1a5cd7735d487158 · xdb4_94051 / vllm · GitLab

Find file Blame History Permalink

Better integration with Ray Serve (#1821) · 0229c386
FlorianJoncour authored Nov 29, 2023
```
Co-authored-by: FlorianJoncour <florian@zetta-sys.com>
```
0229c386

llm_engine.py 31.6 KB