---
id: pr-tensorrt-llm-11473
repo: NVIDIA/TensorRT-LLM
pr: 11473
title: '[None][feat] Optimize by fuse nvfp4_quant to layernorm_gated for mamba2_mixer'
author: Wanli-Jiang
date: '2026-03-07'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/11473
source_category: upstream-code
architectures:
- sm100
tags:
- gemm_quant
- norm_elementwise
- sm100
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- blackwell
- fp4
- nvfp4
kernel_types:
- gemm
- norm
- scan
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: cc16289dfe9d7e55f9e2534a735d9a1e9b4f3f81
inclusion_reason: Look for fusion, vectorization, dtype conversion, and store-traffic reductions before changing math.
changed_paths:
- cpp/tensorrt_llm/CMakeLists.txt
- cpp/tensorrt_llm/kernels/CMakeLists.txt
- cpp/tensorrt_llm/kernels/fusedGatedRMSNormQuant/CMakeLists.txt
- cpp/tensorrt_llm/kernels/fusedGatedRMSNormQuant/fusedGatedRMSNormQuant.cu
- cpp/tensorrt_llm/kernels/fusedGatedRMSNormQuant/fusedGatedRMSNormQuant.cuh
- cpp/tensorrt_llm/thop/CMakeLists.txt
- cpp/tensorrt_llm/thop/fusedGatedRMSNormQuant.cpp
- tensorrt_llm/_torch/custom_ops/cpp_custom_ops.py
- tensorrt_llm/_torch/modules/mamba/layernorm_gated.py
- tensorrt_llm/_torch/modules/mamba/mamba2_mixer.py
- tensorrt_llm/_torch/modules/mamba/ssd_chunk_scan.py
- tensorrt_llm/_torch/modules/rms_norm.py
- tests/unittest/_torch/modules/mamba/test_layernorm_gated.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-11473
head_ref_oid: ad4502cd1aa3b84f8529ed4cf93eb0974fc53e97
---
# [None][feat] Optimize by fuse nvfp4_quant to layernorm_gated for mamba2_mixer

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [11473](https://github.com/NVIDIA/TensorRT-LLM/pull/11473)
- Decision: `Look for fusion, vectorization, dtype conversion, and store-traffic reductions before changing math.`
- Reason: Look for fusion, vectorization, dtype conversion, and store-traffic reductions before changing math.

## Changed Paths

- `cpp/tensorrt_llm/CMakeLists.txt`
- `cpp/tensorrt_llm/kernels/CMakeLists.txt`
- `cpp/tensorrt_llm/kernels/fusedGatedRMSNormQuant/CMakeLists.txt`
- `cpp/tensorrt_llm/kernels/fusedGatedRMSNormQuant/fusedGatedRMSNormQuant.cu`
- `cpp/tensorrt_llm/kernels/fusedGatedRMSNormQuant/fusedGatedRMSNormQuant.cuh`
- `cpp/tensorrt_llm/thop/CMakeLists.txt`
- `cpp/tensorrt_llm/thop/fusedGatedRMSNormQuant.cpp`
- `tensorrt_llm/_torch/custom_ops/cpp_custom_ops.py`
- `tensorrt_llm/_torch/modules/mamba/layernorm_gated.py`
- `tensorrt_llm/_torch/modules/mamba/mamba2_mixer.py`
- `tensorrt_llm/_torch/modules/mamba/ssd_chunk_scan.py`
- `tensorrt_llm/_torch/modules/rms_norm.py`
- `tests/unittest/_torch/modules/mamba/test_layernorm_gated.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-11473`
