examples/multilora_inference.py · 51679bbda84df6e68d4cef8f59abf8f962bf59e0 · kecinstone / 2024pra-vllm

You need to sign in or sign up before continuing.

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

multilora_inference.py 5.33 KB

Replace multilora_inference.py