---
id: pr-tensorrt-llm-12664
repo: NVIDIA/TensorRT-LLM
pr: 12664
title: '[None][feat] AutoDeploy: Add the Triton kernel for MLA'
author: nvchenghaoz
date: '2026-04-08'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/12664
source_category: upstream-code
architectures:
- sm100
tags:
- triton kernel
techniques: []
hardware_features: []
kernel_types:
- mla
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 2fe39c164d97c8d6184ebf1c180f52da8da5dd04
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- examples/auto_deploy/model_registry/configs/mistral_small_4_119b.yaml
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/__init__.py
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/torch_backend_mla.py
- tensorrt_llm/_torch/auto_deploy/custom_ops/mla/triton_mla.py
- tests/unittest/auto_deploy/singlegpu/custom_ops/mla/test_triton_mla_op.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-12664
head_ref_oid: f253181517c6fad0f315e2e8d13535bf3ad2d286
---
# [None][feat] AutoDeploy: Add the Triton kernel for MLA

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [12664](https://github.com/NVIDIA/TensorRT-LLM/pull/12664)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `examples/auto_deploy/model_registry/configs/mistral_small_4_119b.yaml`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/__init__.py`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/torch_backend_mla.py`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/mla/triton_mla.py`
- `tests/unittest/auto_deploy/singlegpu/custom_ops/mla/test_triton_mla_op.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-12664`
