[Experimental] Add multi-LoRA support (#1804)

Co-authored-by: Chen Shen <scv119@gmail.com> Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by: Avnish Narayan <avnish@anyscale.com>

[Experimental] Add multi-LoRA support (#1804)
Co-authored-by: Chen Shen <scv119@gmail.com> Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by: Avnish Narayan <avnish@anyscale.com>
9b945daa · Antoni Baum · GitHub · 9c1352eb · 9b945daa · 9b945daa
Unverified Commit 9b945daa authored Jan 24, 2024 by Antoni Baum Committed by GitHub Jan 23, 2024
12 changed files
--- a/vllm/model_executor/layers/vocab_parallel_embedding.py
+++ b/vllm/model_executor/layers/vocab_parallel_embedding.py
--- a/vllm/model_executor/model_loader.py
+++ b/vllm/model_executor/model_loader.py
--- a/vllm/model_executor/models/llama.py
+++ b/vllm/model_executor/models/llama.py
--- a/vllm/model_executor/models/mistral.py
+++ b/vllm/model_executor/models/mistral.py
--- a/vllm/model_executor/parallel_utils/parallel_state.py
+++ b/vllm/model_executor/parallel_utils/parallel_state.py
--- a/vllm/outputs.py
+++ b/vllm/outputs.py
--- a/vllm/prefix.py
+++ b/vllm/prefix.py
--- a/vllm/sequence.py
+++ b/vllm/sequence.py
--- a/vllm/transformers_utils/tokenizer.py
+++ b/vllm/transformers_utils/tokenizer.py
--- a/vllm/utils.py
+++ b/vllm/utils.py
--- a/vllm/worker/model_runner.py
+++ b/vllm/worker/model_runner.py
--- a/vllm/worker/worker.py
+++ b/vllm/worker/worker.py