Unverified Commit 4f4857a4 authored by Billel Mokeddem's avatar Billel Mokeddem Committed by GitHub
Browse files

Fix: Change embeddings to embedding (#2738)



fix: change embeddings to embedding
Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-28-135.us-west-2.compute.internal>
parent f9ee46f7
......@@ -212,7 +212,7 @@ class MambaModel(nn.Module):
try:
self.lm_head = SpeculativeHead.load(config, f"{prefix}.embeddings", weights)
except RuntimeError:
self.lm_head = SpeculativeHead.load(config, f"{prefix}.embeddings", weights)
self.lm_head = SpeculativeHead.load(config, f"{prefix}.embedding", weights)
self.config = config
def forward(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment