vllm/engine/llm_engine.py · 062c89e7c9c6fa9fd7fb2d28fd50321c6f78f389 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
062c89e7

llm_engine.py 83 KB