Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c7991269
Unverified
Commit
c7991269
authored
Nov 11, 2025
by
Fanli Lin
Committed by
GitHub
Nov 11, 2025
Browse files
[BugFix] 'DeepseekV2Config' object has no attribute 'use_mla'` (#28387)
Signed-off-by:
Lin, Fanli
<
fanli.lin@intel.com
>
parent
f0359fff
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
1 deletion
+5
-1
vllm/model_executor/models/kimi_vl.py
vllm/model_executor/models/kimi_vl.py
+5
-1
No files found.
vllm/model_executor/models/kimi_vl.py
View file @
c7991269
...
...
@@ -456,7 +456,11 @@ class KimiVLForConditionalGeneration(nn.Module, SupportsMultiModal, SupportsPP):
(
".gate_up_proj"
,
".gate_proj"
,
0
),
(
".gate_up_proj"
,
".up_proj"
,
1
),
]
if
not
config
.
use_mla
:
use_mha
=
(
config
.
model_type
==
"deepseek"
or
config
.
qk_nope_head_dim
+
config
.
qk_rope_head_dim
==
0
)
if
use_mha
:
stacked_params_mapping
+=
[
(
".qkv_proj"
,
".q_proj"
,
"q"
),
(
".qkv_proj"
,
".k_proj"
,
"k"
),
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment