---
id: pr-tensorrt-llm-10226
repo: NVIDIA/TensorRT-LLM
pr: 10226
title: '[TRTLLM-9798][feat] Change to use new DeepGEMM MQA sm100 kernel for MTP-3'
author: lfr-0531
date: '2025-12-24'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/10226
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- arch_pipeline
- attention_kv
- benchmark_test
- gemm_quant
- paged MQA
- sm100
- sm90
techniques:
- fine-grained-quantization
- pipeline-stages
hardware_features:
- blackwell
- hopper
kernel_types:
- attention
- gemm
- runtime
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 156f6453dc2101cef012eb3592efedc26af7830e
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tensorrt_llm/_torch/attention_backend/sparse/dsa.py
- tests/unittest/_torch/attention/sparse/test_dsa_indexer.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-10226
head_ref_oid: 008591eadcabc632c09fa62afd612d0c4bf6cf66
---
# [TRTLLM-9798][feat] Change to use new DeepGEMM MQA sm100 kernel for MTP-3

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [10226](https://github.com/NVIDIA/TensorRT-LLM/pull/10226)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tensorrt_llm/_torch/attention_backend/sparse/dsa.py`
- `tests/unittest/_torch/attention/sparse/test_dsa_indexer.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-10226`
