benchmarks/benchmark_serving_structured_output.py · 34120f5acd693924cc783dfaa33733afbe9ae8b0 · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "ed812a73fae77bb520b739cfeaad36dbd61e2b03"

Find file Blame History Permalink

[V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702) · 34120f5a
Benjamin Chislett authored Apr 29, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
34120f5a

benchmark_serving_structured_output.py 37.3 KB