Commit 8fc64935 authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-wm-1113' into 'v0.9.2-dev'

[fix]解决DeepSeek-V3.2 mtp启动失败

See merge request dcutoolkit/deeplearing/vllm!253
parents e720f7cf de8e0fa8
......@@ -214,7 +214,7 @@ class DeepSeekMTP(nn.Module, SupportsPP):
params_dict = dict(self.named_parameters())
loaded_params: set[str] = set()
for name, loaded_weight in weights:
if "rotary_emb.inv_freq" in name:
if "rotary_emb.inv_freq" in name or "indexer" in name:
continue
spec_layer = get_spec_layer_idx_from_weight_name(self.config, name)
if spec_layer is None:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment