Unverified Commit aa375dca authored by Szymon Ożóg's avatar Szymon Ożóg Committed by GitHub
Browse files

[Bugfix] Missing quant_config in deepseek embedding layer (#12836)

parent 433c4a49
...@@ -581,7 +581,8 @@ class DeepseekV2Model(nn.Module): ...@@ -581,7 +581,8 @@ class DeepseekV2Model(nn.Module):
self.embed_tokens = VocabParallelEmbedding( self.embed_tokens = VocabParallelEmbedding(
config.vocab_size, config.vocab_size,
config.hidden_size, config.hidden_size,
) quant_config=quant_config,
prefix=f"{prefix}.embed_tokens")
else: else:
self.embed_tokens = PPMissingLayer() self.embed_tokens = PPMissingLayer()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment