---
id: pr-flashinfer-2743
repo: flashinfer-ai/flashinfer
pr: 2743
title: Add cute dsl mla decode op
author: limin2021
date: '2026-03-26'
url: https://github.com/flashinfer-ai/flashinfer/pull/2743
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- decode
- fp8
- mla
techniques: []
hardware_features:
- fp8
kernel_types:
- attention
- decode
- mla
languages:
- cute-dsl
captured_at: '2026-04-27'
status: merged
merge_sha: 31b63bc3d73597612419b4831218feabc57fd97d
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/README.md
- benchmarks/bench_trtllm_gen_mla.py
- benchmarks/routines/attention.py
- benchmarks/routines/flashinfer_benchmark_utils.py
- flashinfer/cute_dsl/__init__.py
- flashinfer/cute_dsl/utils.py
- flashinfer/mla/__init__.py
- flashinfer/mla/_core.py
- flashinfer/mla/cute_dsl/__init__.py
- flashinfer/mla/cute_dsl/mla_decode.py
- flashinfer/mla/cute_dsl/mla_decode_fp16.py
- flashinfer/mla/cute_dsl/mla_decode_fp8.py
- flashinfer/mla/cute_dsl/mla_helpers.py
- tests/attention/test_cute_dsl_mla_decode.py
- tests/attention/test_trtllm_gen_mla.py
head_ref_oid: adafa35ac1aee3f5c4de02273a57acd0c9c6123c
artifact_dir: evidence/pull-bundles/flashinfer/gh-2743
---
# Add cute dsl mla decode op

- Repository: `flashinfer-ai/flashinfer`
- PR: [2743](https://github.com/flashinfer-ai/flashinfer/pull/2743)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/README.md`
- `benchmarks/bench_trtllm_gen_mla.py`
- `benchmarks/routines/attention.py`
- `benchmarks/routines/flashinfer_benchmark_utils.py`
- `flashinfer/cute_dsl/__init__.py`
- `flashinfer/cute_dsl/utils.py`
- `flashinfer/mla/__init__.py`
- `flashinfer/mla/_core.py`
- `flashinfer/mla/cute_dsl/__init__.py`
- `flashinfer/mla/cute_dsl/mla_decode.py`
- `flashinfer/mla/cute_dsl/mla_decode_fp16.py`
- `flashinfer/mla/cute_dsl/mla_decode_fp8.py`
- `flashinfer/mla/cute_dsl/mla_helpers.py`
- `tests/attention/test_cute_dsl_mla_decode.py`
- `tests/attention/test_trtllm_gen_mla.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2743`
