benchmarks/benchmark_latency.py · 7d648418b8b1aadb90489ef18cff1763ffc82ed5 · norm / vllm

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

benchmark_latency.py 4.89 KB

Replace benchmark_latency.py