---
id: pr-flashinfer-1348
repo: flashinfer-ai/flashinfer
pr: 1348
title: 'fix: fix trtllm-gen mla error on new interface'
author: yyihuang
date: '2025-07-29'
url: https://github.com/flashinfer-ai/flashinfer/pull/1348
source_category: upstream-code
architectures:
- sm100
tags:
- decode
- flash-attention
- mla
techniques: []
hardware_features: []
kernel_types:
- decode
- flash-attention
- mla
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: e9f43f094edfdccbb01520ae15d7f8dc6f302378
inclusion_reason: kernel file changes
changed_paths:
- csrc/trtllm_fmha_kernel_launcher.cu
- flashinfer/decode.py
- tests/test_trtllm_gen_decode.py
head_ref_oid: 5e4d1e09290df77b89e1eff92ae9d1fdf129e8d8
artifact_dir: evidence/pull-bundles/flashinfer/gh-1348
---
# fix: fix trtllm-gen mla error on new interface

- Repository: `flashinfer-ai/flashinfer`
- PR: [1348](https://github.com/flashinfer-ai/flashinfer/pull/1348)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/trtllm_fmha_kernel_launcher.cu`
- `flashinfer/decode.py`
- `tests/test_trtllm_gen_decode.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1348`
