benchmarks/benchmark_latency.py · f07c1ceaa5162e2ad3b127e06b162508dc57e4db · norm / vllm

chooper1 authored Oct 22, 2023


Co-authored-by: squeeze-ai-lab <squeezeailab.bair@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

1f24755b

benchmark_latency.py 3.58 KB