Skip to content

GitLab

Unverified Commit 1761dea1 authored by yyzxw's avatar yyzxw Committed by GitHub
Browse files

[BugFix]: --enable-lora with model granite-4.0-micro crash (#27733) 


Signed-off-by: default avatarzxw <1020938856@qq.com>
parent c748355e
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
vllm/model_executor/models/granitemoehybrid.py
View file @ 1761dea1
...@@ -597,6 +597,9 @@ class GraniteMoeHybridForCausalLM( ...@@ -597,6 +597,9 @@ class GraniteMoeHybridForCausalLM(
"k_proj", "k_proj",
"v_proj", "v_proj",
], ],
"conv1d": ["conv1d"],
"in_proj": ["in_proj"],
"input_linear": ["input_linear"],
} }
embedding_modules = { embedding_modules = {
"embed_tokens": "input_embeddings", "embed_tokens": "input_embeddings",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment