benchmarks/benchmark_serving_structured_output.py · b88be2216549a7d2281153a8542fca2aea06681c · OpenDAS / vllm_cscc

[Misc][Benchmark] Add support for different `tokenizer_mode` (#15040) · 6c5a3195

Aaron Pham authored Mar 19, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

6c5a3195

benchmark_serving_structured_output.py 37.1 KB

Replace benchmark_serving_structured_output.py