Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c5b8b595
Unverified
Commit
c5b8b595
authored
Jul 17, 2025
by
Jee Jee Li
Committed by
GitHub
Jul 17, 2025
Browse files
[Misc] Fix PhiMoE expert mapping (#21085)
Signed-off-by:
Jee Jee Li
<
pandaleefree@gmail.com
>
parent
4fcef49e
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
6 deletions
+1
-6
vllm/model_executor/models/phimoe.py
vllm/model_executor/models/phimoe.py
+1
-6
No files found.
vllm/model_executor/models/phimoe.py
View file @
c5b8b595
...
...
@@ -533,14 +533,9 @@ class PhiMoEModel(nn.Module):
(
"qkv_proj"
,
"v_proj"
,
"v"
),
]
expert_params_mapping
=
FusedMoE
.
make_expert_params_mapping
(
ckpt_gate_proj_name
=
"w1"
,
ckpt_down_proj_name
=
"w2"
,
ckpt_up_proj_name
=
"w3"
,
num_experts
=
self
.
config
.
num_local_experts
)
params_dict
=
dict
(
self
.
named_parameters
())
loaded_params
:
set
[
str
]
=
set
()
expert_params_mapping
=
self
.
get_expert_mapping
()
for
name
,
loaded_weight
in
weights
:
if
(
self
.
quant_config
is
not
None
and
(
scale_name
:
=
self
.
quant_config
.
get_cache_scale
(
name
))):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment