vllm/v1/engine/llm_engine.py · 4d251ad00ea11ecdf369aa10b9abecf96505b8dc · OpenDAS / vllm_cscc · GitLab

"vscode:/vscode.git/clone" did not exist on "769d0629e1c55d0a92dbf7244e7a6de4103c6ba4"

Find file Blame History Permalink

[V1] V1 engine implements parallel sampling (AsyncLLM and LLMEngine) (#10980) · befc402d
afeldman-nm authored Feb 24, 2025
```
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
befc402d

llm_engine.py 9.94 KB