vllm/engine/async_llm_engine.py · 9b945daaf1ce03b8b02d68b37c59baf28566b535 · kecinstone / 2024pra-vllm

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

async_llm_engine.py 23.7 KB

Replace async_llm_engine.py