benchmarks/benchmark_throughput.py · 0ca3b8e01cae898eeb6fdf4865cfcec3cf4b5d14 · OpenDAS / vllm_cscc

[BUGFIX] Skip tokenization support for throughput benchmark (#12712) · 0ca3b8e0

Aleksandr Malyshev authored Mar 07, 2025


Signed-off-by: root <root@banff-cyxtera-s73-5.ctr.dcgpu>
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s73-5.ctr.dcgpu>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>

0ca3b8e0

benchmark_throughput.py 22 KB

Replace benchmark_throughput.py