vllm/engine/async_llm_engine.py · a130cf331ef8b91197150e5a47a09e2b9487e61b · norm / vllm · GitLab

Find file Blame History Permalink

Add guided decoding for OpenAI API server (#2819) · 703e42ee
felixzhu555 authored Feb 29, 2024
```
Co-authored-by: br3no <breno@veltefaria.de>
Co-authored-by: simon-mo <simon.mo@hey.com>
```
703e42ee

async_llm_engine.py 24.1 KB