vllm/worker/model_runner.py · 220a47627bf48c728ce0a2737be39c400bb6f653 · kecinstone / 2024pra-vllm

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

model_runner.py 33.7 KB

Replace model_runner.py