---
id: pr-tensorrt-llm-12055
repo: NVIDIA/TensorRT-LLM
pr: 12055
title: '[TRTLLM-11285][feat] Fuse indexer wk + weights_proj into single GEMM in TF32 for DS-V3.2'
author: peihu-nv
date: '2026-03-18'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/12055
source_category: upstream-code
architectures:
- sm100
tags:
- DSA
- attention_kv
- benchmark_test
- gemm_quant
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features: []
kernel_types:
- attention
- gemm
- mla
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 4b915d4f9bdaefe6fbdc6b11151a76ccb658fd52
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- tensorrt_llm/_torch/attention_backend/sparse/dsa.py
- tensorrt_llm/_torch/modules/attention.py
- tests/unittest/_torch/attention/sparse/test_short_seq_mha.py
- tests/unittest/_torch/attention/sparse/test_sparse_mla_forward.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-12055
head_ref_oid: 6f744c132235ef5c026c5197cc33c38a111ccd8d
---
# [TRTLLM-11285][feat] Fuse indexer wk + weights_proj into single GEMM in TF32 for DS-V3.2

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [12055](https://github.com/NVIDIA/TensorRT-LLM/pull/12055)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `tensorrt_llm/_torch/attention_backend/sparse/dsa.py`
- `tensorrt_llm/_torch/modules/attention.py`
- `tests/unittest/_torch/attention/sparse/test_short_seq_mha.py`
- `tests/unittest/_torch/attention/sparse/test_sparse_mla_forward.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-12055`
