benchmarks/benchmark_serving_structured_output.py · 8d5aa466fbff258159ecb0ac85134f5356b5344c · OpenDAS / vllm_cscc

[V1][Core] Support for Structured Outputs (#12388) · 80e9afb5

Aaron Pham authored Mar 07, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

80e9afb5

benchmark_serving_structured_output.py 36.1 KB

Replace benchmark_serving_structured_output.py