---
id: pr-tensorrt-llm-13410
repo: NVIDIA/TensorRT-LLM
pr: 13410
title: '[None][fix] Add support for context multiCtaKv sparse fmha'
author: heyuhhh
date: '2026-05-06'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13410
source_category: upstream-code
architectures:
- sm100
tags:
- attention kernel
- fmha
techniques: []
hardware_features: []
kernel_types:
- attention
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 901c22373a21ca38e1ad0814d51471c1108302e7
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- cpp/tensorrt_llm/common/attentionOp.cpp
- cpp/tensorrt_llm/common/attentionOp.h
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/fused_multihead_attention_common.h
- cpp/tensorrt_llm/kernels/fmhaDispatcher.cpp
- cpp/tensorrt_llm/kernels/trtllmGenKernels/fmha/fmhaKernels.h
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13410
head_ref_oid: 37dd13f1a34245d11d22913cb8a261fdacce5df1
---
# [None][fix] Add support for context multiCtaKv sparse fmha

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13410](https://github.com/NVIDIA/TensorRT-LLM/pull/13410)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `cpp/tensorrt_llm/common/attentionOp.cpp`
- `cpp/tensorrt_llm/common/attentionOp.h`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/fused_multihead_attention_common.h`
- `cpp/tensorrt_llm/kernels/fmhaDispatcher.cpp`
- `cpp/tensorrt_llm/kernels/trtllmGenKernels/fmha/fmhaKernels.h`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13410`
