---
id: pr-tensorrt-llm-13222
repo: NVIDIA/TensorRT-LLM
pr: 13222
title: '[#11823][feat] AutoDeploy trtllm_mla attention backend'
author: MrGeva
date: '2026-04-30'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13222
source_category: upstream-code
architectures:
- sm90
tags:
- fmha
- fp8
- sm90
techniques: []
hardware_features:
- fp8
- hopper
kernel_types:
- attention
- mla
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 2f0e23659f5e5d5e24a5731bfac27655916f9a86
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- cpp/tensorrt_llm/common/attentionOp.h
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/fmhaRunner.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/fused_multihead_attention_common.h
- cpp/tensorrt_llm/thop/attentionOp.cpp
- examples/auto_deploy/create_standalone_package.py
- examples/auto_deploy/model_registry/configs/deepseek-r1.yaml
- tensorrt_llm/_torch/auto_deploy/compile/piecewise_utils.py
- tensorrt_llm/_torch/auto_deploy/config/default.yaml
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/__init__.py
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/flashinfer_mla.py
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/torch_backend_mla.py
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/trtllm_mla.py
- tensorrt_llm/_torch/auto_deploy/models/hf.py
- tensorrt_llm/_torch/auto_deploy/transform/library/fuse_rope_mla.py
- tests/integration/defs/accuracy/references/gsm8k.yaml
- tests/integration/defs/accuracy/references/mmlu.yaml
- tests/unittest/auto_deploy/singlegpu/custom_ops/mla/test_trtllm_mla_op.py
- tests/unittest/auto_deploy/singlegpu/custom_ops/normalization/test_triton_rms_norm.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13222
head_ref_oid: 161b49f16f06dc5a813a02cfcf00ee951d7c4b44
---
# [#11823][feat] AutoDeploy trtllm_mla attention backend

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13222](https://github.com/NVIDIA/TensorRT-LLM/pull/13222)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `cpp/tensorrt_llm/common/attentionOp.h`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/fmhaRunner.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/fused_multihead_attention_common.h`
- `cpp/tensorrt_llm/thop/attentionOp.cpp`
- `examples/auto_deploy/create_standalone_package.py`
- `examples/auto_deploy/model_registry/configs/deepseek-r1.yaml`
- `tensorrt_llm/_torch/auto_deploy/compile/piecewise_utils.py`
- `tensorrt_llm/_torch/auto_deploy/config/default.yaml`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/__init__.py`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/flashinfer_mla.py`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/torch_backend_mla.py`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/trtllm_mla.py`
- `tensorrt_llm/_torch/auto_deploy/models/hf.py`
- `tensorrt_llm/_torch/auto_deploy/transform/library/fuse_rope_mla.py`
- `tests/integration/defs/accuracy/references/gsm8k.yaml`
- `tests/integration/defs/accuracy/references/mmlu.yaml`
- `tests/unittest/auto_deploy/singlegpu/custom_ops/mla/test_trtllm_mla_op.py`
- `tests/unittest/auto_deploy/singlegpu/custom_ops/normalization/test_triton_rms_norm.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13222`
