Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
fc809665
Unverified
Commit
fc809665
authored
Sep 19, 2025
by
Jinyan Chen
Committed by
GitHub
Sep 18, 2025
Browse files
[Performance] qwen3-next improve causal conv1d in prefill phase (#10595)
Co-authored-by:
Jinyan Chen
<
jinyanc@nvidia.com
>
parent
6fd4816d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
python/sglang/srt/layers/attention/hybrid_linear_attn_backend.py
...sglang/srt/layers/attention/hybrid_linear_attn_backend.py
+4
-1
No files found.
python/sglang/srt/layers/attention/hybrid_linear_attn_backend.py
View file @
fc809665
...
...
@@ -13,6 +13,9 @@ from sglang.srt.layers.attention.fla.fused_recurrent import (
from
sglang.srt.layers.attention.fla.fused_sigmoid_gating_recurrent
import
(
fused_sigmoid_gating_delta_rule_update
,
)
from
sglang.srt.layers.attention.mamba.causal_conv1d
import
(
causal_conv1d_fn
as
causal_conv1d_fn_sgl
,
)
from
sglang.srt.layers.attention.mamba.causal_conv1d_triton
import
(
causal_conv1d_fn
,
causal_conv1d_update
,
...
...
@@ -334,7 +337,7 @@ class MambaAttnBackend(AttentionBackend):
mixed_qkv_processed
.
transpose
(
1
,
2
).
contiguous
().
view
(
seq_len
,
-
1
)
)
else
:
mixed_qkv
=
causal_conv1d_fn
(
mixed_qkv
=
causal_conv1d_fn
_sgl
(
mixed_qkv
.
transpose
(
0
,
1
),
conv_weights
,
bias
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment