vllm/engine/llm_engine.py · 8a74c68bd1ae48cb71e4c3bf9d7ff9a2ef8f9dae · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Introduce SPMD worker execution using Ray accelerated DAG (#6032) · 61e59274
Rui Qiao authored Jul 17, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Stephanie Wang <swang@cs.berkeley.edu>
```
61e59274

llm_engine.py 49.4 KB