vllm/v1/engine/parallel_sampling.py · bf33700ecd6db472c4aeb489c5d42aa47a735198 · OpenDAS / vllm_cscc · GitLab

"docs/Makefile" did not exist on "655a5e48df3937bf793add53aa95ce0c992a24c6"

Find file Blame History Permalink

[V1] V1 engine implements parallel sampling (AsyncLLM and LLMEngine) (#10980) · befc402d
afeldman-nm authored Feb 24, 2025
```
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
befc402d

parallel_sampling.py 13.7 KB