vllm/worker/model_runner.py · 9b945daaf1ce03b8b02d68b37c59baf28566b535 · OpenDAS / vllm_cscc

"benchmarks/kernels/benchmark_layernorm.py" did not exist on "9984605412de1171a72d955cfcb954725edd4d6f"

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

model_runner.py 33.7 KB

Replace model_runner.py