Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
f381cf23
Unverified
Commit
f381cf23
authored
Oct 21, 2025
by
Benjamin Chislett
Committed by
GitHub
Oct 20, 2025
Browse files
[Bugfix] Fix broken MTP weight loading for FP8 KV Scales (#27227)
Signed-off-by:
Benjamin Chislett
<
bchislett@nvidia.com
>
parent
5ff5d94e
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
1 deletion
+8
-1
vllm/model_executor/models/deepseek_mtp.py
vllm/model_executor/models/deepseek_mtp.py
+8
-1
No files found.
vllm/model_executor/models/deepseek_mtp.py
View file @
f381cf23
...
@@ -16,7 +16,10 @@ from vllm.model_executor.layers.vocab_parallel_embedding import (
...
@@ -16,7 +16,10 @@ from vllm.model_executor.layers.vocab_parallel_embedding import (
ParallelLMHead
,
ParallelLMHead
,
VocabParallelEmbedding
,
VocabParallelEmbedding
,
)
)
from
vllm.model_executor.model_loader.weight_utils
import
default_weight_loader
from
vllm.model_executor.model_loader.weight_utils
import
(
default_weight_loader
,
maybe_remap_kv_scale_name
,
)
from
vllm.platforms
import
current_platform
from
vllm.platforms
import
current_platform
from
vllm.sequence
import
IntermediateTensors
from
vllm.sequence
import
IntermediateTensors
...
@@ -278,6 +281,10 @@ class DeepSeekMTP(nn.Module, SupportsPP):
...
@@ -278,6 +281,10 @@ class DeepSeekMTP(nn.Module, SupportsPP):
if
name
.
endswith
(
".bias"
)
and
name
not
in
params_dict
:
if
name
.
endswith
(
".bias"
)
and
name
not
in
params_dict
:
continue
continue
name
=
maybe_remap_kv_scale_name
(
name
,
params_dict
)
if
name
is
None
:
continue
# According to DeepSeek-V3 Technical Report, MTP modules
# According to DeepSeek-V3 Technical Report, MTP modules
# shares embedding layer. We only load the first weights.
# shares embedding layer. We only load the first weights.
if
(
if
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment