benchmarks/benchmark_throughput.py · 1f24755bf802a2061bd46f3dd1191b7898f13f45 · norm / vllm

chooper1 authored Oct 22, 2023


Co-authored-by: squeeze-ai-lab <squeezeailab.bair@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

1f24755b

benchmark_throughput.py 8.8 KB