Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
dec8b944
Commit
dec8b944
authored
Mar 27, 2026
by
laibao
Browse files
fix(qwen3 moe): 修正 fused RMS RoPE 的 epsilon 参数传递顺序
parent
8bc2cc01
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/model_executor/models/qwen3_moe.py
vllm/model_executor/models/qwen3_moe.py
+1
-1
No files found.
vllm/model_executor/models/qwen3_moe.py
View file @
dec8b944
...
...
@@ -391,9 +391,9 @@ class Qwen3MoeAttention(nn.Module):
self
.
rotary_emb
.
is_neox_style
,
self
.
q_norm
.
weight
,
self
.
k_norm
.
weight
,
self
.
q_norm
.
variance_epsilon
,
None
,
None
,
self
.
q_norm
.
variance_epsilon
,
)
elif
envs
.
VLLM_USE_FUSED_RMS_ROPE
and
positions
.
ndim
==
2
and
getattr
(
self
.
rotary_emb
,
"mrope_section"
,
None
)
is
not
None
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment