Skip to content

GitLab

Unverified Commit a6f37218 authored by Will Johnson's avatar Will Johnson Committed by GitHub
Browse files

[Model] add a lora module for granite 3.0 MoE models (#9673)

parent 9f7b4ba8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/model_executor/models/granitemoe.py
View file @ a6f37218
...@@ -324,6 +324,7 @@ class GraniteMoeForCausalLM(nn.Module, SupportsLoRA, SupportsPP): ...@@ -324,6 +324,7 @@ class GraniteMoeForCausalLM(nn.Module, SupportsLoRA, SupportsPP):
"o_proj", "o_proj",
"embed_tokens", "embed_tokens",
"lm_head", "lm_head",
"layer",
] ]
embedding_modules = { embedding_modules = {
"embed_tokens": "input_embeddings", "embed_tokens": "input_embeddings",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment