---
id: pr-tensorrt-llm-13628
repo: NVIDIA/TensorRT-LLM
pr: 13628
title: '[None][feat] Fuse FP8 1x128 quantize + UE8M0 scale pack on SM100'
author: lishicheng1996-nv
date: '2026-04-30'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13628
source_category: upstream-code
architectures:
- sm100
tags:
- arch_pipeline
- attention kernel
- cutlass
- fp8
- gemm_quant
- sm100
techniques:
- async-copy
- fine-grained-quantization
- kernel-fusion
- pipeline-stages
hardware_features:
- blackwell
- fp8
- tma
kernel_types:
- attention
- gemm
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: f51b0ae7fd6262e3e30b6bd5281b148156451955
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- cpp/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_quant_packed.cu
- cpp/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_quant_packed.h
- cpp/tensorrt_llm/thop/fp8Quantize.cpp
- tensorrt_llm/_torch/custom_ops/cpp_custom_ops.py
- tensorrt_llm/_torch/custom_ops/torch_custom_ops.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13628
head_ref_oid: 861be2625b41343142d91a2e12cdad3e71ddcca0
---
# [None][feat] Fuse FP8 1x128 quantize + UE8M0 scale pack on SM100

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13628](https://github.com/NVIDIA/TensorRT-LLM/pull/13628)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `cpp/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_quant_packed.cu`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_quant_packed.h`
- `cpp/tensorrt_llm/thop/fp8Quantize.cpp`
- `tensorrt_llm/_torch/custom_ops/cpp_custom_ops.py`
- `tensorrt_llm/_torch/custom_ops/torch_custom_ops.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13628`
