vllm/engine/async_llm_engine.py · e00b0a190e3b30c7bdb869305fece43c7f25ce59 · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "4634c8728b0fe30a0b2da22dd4a4c8d8a1d9213b"

Find file Blame History Permalink

Add guided decoding for OpenAI API server (#2819) · 703e42ee
felixzhu555 authored Feb 29, 2024
```
Co-authored-by: br3no <breno@veltefaria.de>
Co-authored-by: simon-mo <simon.mo@hey.com>
```
703e42ee

async_llm_engine.py 24.1 KB