vllm/engine/async_llm_engine.py · 1fe0a4264aa94ceeccc7e8d99ac0d72f0560f541 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
062c89e7

async_llm_engine.py 48.9 KB