Skip to content

GitLab

Unverified Commit d747c2ef authored by Corey Lowman's avatar Corey Lowman Committed by GitHub
Browse files

[Perf] Fix jit compiles at runtime of fla gated delta rule (#25432) 


Co-authored-by: default avatarMichael Goin <mgoin64@gmail.com>
parent c30b405b
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/model_executor/layers/fla/ops/fused_recurrent.py
View file @ d747c2ef
...@@ -40,8 +40,8 @@ def fused_recurrent_gated_delta_rule_fwd_kernel( ...@@ -40,8 +40,8 @@ def fused_recurrent_gated_delta_rule_fwd_kernel(
ssm_state_indices, ssm_state_indices,
num_accepted_tokens, num_accepted_tokens,
scale, scale,
N: tl.constexpr, # num of sequences N: tl.int64, # num of sequences
T: tl.constexpr, # num of tokens T: tl.int64, # num of tokens
B: tl.constexpr, B: tl.constexpr,
H: tl.constexpr, H: tl.constexpr,
HV: tl.constexpr, HV: tl.constexpr,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment