Skip to content

GitLab

Unverified Commit 7961486a authored by Julien Denize's avatar Julien Denize Committed by GitHub
Browse files

Fix EagleMistralLarge3Model initialization (#37232) 


Signed-off-by: default avatarjuliendenize <julien.denize@mistral.ai>
parent 4f9b14c2
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/model_executor/models/mistral_large_3_eagle.py
View file @ 7961486a
...@@ -74,6 +74,7 @@ class EagleMistralLarge3Model(DeepseekV2Model): ...@@ -74,6 +74,7 @@ class EagleMistralLarge3Model(DeepseekV2Model):
prefix=maybe_prefix(prefix, "fc"), prefix=maybe_prefix(prefix, "fc"),
) )
self.norm = RMSNorm(config.hidden_size, eps=config.rms_norm_eps) self.norm = RMSNorm(config.hidden_size, eps=config.rms_norm_eps)
self.aux_hidden_state_layers: tuple[int, ...] = ()
self.make_empty_intermediate_tensors = make_empty_intermediate_tensors_factory( self.make_empty_intermediate_tensors = make_empty_intermediate_tensors_factory(
["hidden_states", "residual"], config.hidden_size ["hidden_states", "residual"], config.hidden_size
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment