vllm/v1/engine/llm_engine.py · befc402d34c2563477ff33bfdd9548ae20a42acd · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] V1 engine implements parallel sampling (AsyncLLM and LLMEngine) (#10980) · befc402d
afeldman-nm authored Feb 24, 2025
```
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
befc402d

llm_engine.py 9.94 KB