Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
02b0d6ba
Commit
02b0d6ba
authored
Mar 02, 2026
by
laibao
Browse files
fix(qwen3): 修复VL场景fused RoPE分支条件,并更正qwen3_moe中rms_mrope参数顺序
parent
1ce0a9a2
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
vllm/model_executor/models/qwen3.py
vllm/model_executor/models/qwen3.py
+1
-1
vllm/model_executor/models/qwen3_moe.py
vllm/model_executor/models/qwen3_moe.py
+1
-1
No files found.
vllm/model_executor/models/qwen3.py
View file @
02b0d6ba
...
...
@@ -196,7 +196,7 @@ class Qwen3Attention(nn.Module):
)
->
torch
.
Tensor
:
qkv
,
_
=
self
.
qkv_proj
(
hidden_states
)
q
,
k
,
v
=
qkv
.
split
([
self
.
q_size
,
self
.
kv_size
,
self
.
kv_size
],
dim
=-
1
)
if
envs
.
VLLM_USE_FUSED_RMS_ROPE
:
if
envs
.
VLLM_USE_FUSED_RMS_ROPE
and
positions
.
ndim
==
1
:
# Fused RMSNorm + RoPE path through custom op.
cos_sin_cache
=
self
.
rotary_emb
.
cos_sin_cache
if
(
cos_sin_cache
.
device
!=
q
.
device
...
...
vllm/model_executor/models/qwen3_moe.py
View file @
02b0d6ba
...
...
@@ -444,9 +444,9 @@ class Qwen3MoeAttention(nn.Module):
mrope_interleaved
,
q_weight
,
k_weight
,
epsilon
,
q_residual
,
k_residual
,
epsilon
,
)
def
rms_mrope_fuse_fake
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment