---
id: pr-tensorrt-llm-9854
repo: NVIDIA/TensorRT-LLM
pr: 9854
title: '[None][feat] Port fp4 quantization kernel optimization from FlashInfer'
author: bkryu
date: '2025-12-10'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/9854
source_category: upstream-code
architectures:
- sm90
tags:
- attention_kv
- blockScaleMoe
- gemm_quant
- sm90
techniques:
- fine-grained-quantization
- swizzling
hardware_features:
- fp4
- hopper
kernel_types:
- attention
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 8cec2da3758234c8f0dbc52963b98fecf68651a7
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- cpp/tensorrt_llm/kernels/quantization.cuh
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-9854
head_ref_oid: 12eb44135308c7a1dc494ffce7424206ff6f8200
---
# [None][feat] Port fp4 quantization kernel optimization from FlashInfer

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [9854](https://github.com/NVIDIA/TensorRT-LLM/pull/9854)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `cpp/tensorrt_llm/kernels/quantization.cuh`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-9854`
