---
id: pr-tensorrt-llm-10130
repo: NVIDIA/TensorRT-LLM
pr: 10130
title: '[TRTLLM-9457][feat] Add cute dsl fp8 gemm for Blackwell'
author: yifeizhang-c
date: '2026-02-06'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/10130
source_category: upstream-code
architectures:
- sm100
tags:
- arch_pipeline
- attention_kv
- compiler_runtime
- cute dsl
- gemm_quant
techniques:
- fine-grained-quantization
- pipeline-stages
hardware_features:
- blackwell
- fp8
kernel_types:
- attention
- compiler
- gemm
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 5521c7b7e72eee8569356012833c2c6568ab4e5a
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- cpp/tensorrt_llm/thop/fp8Quantize.cpp
- tensorrt_llm/_torch/compilation/utils.py
- tensorrt_llm/_torch/custom_ops/cute_dsl_custom_ops.py
- tensorrt_llm/_torch/custom_ops/torch_custom_ops.py
- tensorrt_llm/_torch/cute_dsl_kernels/blackwell/blockwise_gemm/__init__.py
- tensorrt_llm/_torch/cute_dsl_kernels/blackwell/blockwise_gemm/blockwise_gemm.py
- tensorrt_llm/_torch/model_config.py
- tensorrt_llm/_torch/models/modeling_deepseekv3.py
- tensorrt_llm/_torch/modules/attention.py
- tensorrt_llm/_torch/modules/linear.py
- tensorrt_llm/_torch/pyexecutor/model_loader.py
- tensorrt_llm/_torch/utils.py
- tensorrt_llm/llmapi/llm_args.py
- tests/integration/defs/accuracy/test_llm_api_pytorch.py
- tests/unittest/_torch/thop/parallel/test_fp8_block_scale_gemm.py
- tests/unittest/api_stability/references/llm.yaml
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-10130
head_ref_oid: fcef387ff7ec1f77a5ddaecb59dec52b1afbd2e5
---
# [TRTLLM-9457][feat] Add cute dsl fp8 gemm for Blackwell

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [10130](https://github.com/NVIDIA/TensorRT-LLM/pull/10130)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `cpp/tensorrt_llm/thop/fp8Quantize.cpp`
- `tensorrt_llm/_torch/compilation/utils.py`
- `tensorrt_llm/_torch/custom_ops/cute_dsl_custom_ops.py`
- `tensorrt_llm/_torch/custom_ops/torch_custom_ops.py`
- `tensorrt_llm/_torch/cute_dsl_kernels/blackwell/blockwise_gemm/__init__.py`
- `tensorrt_llm/_torch/cute_dsl_kernels/blackwell/blockwise_gemm/blockwise_gemm.py`
- `tensorrt_llm/_torch/model_config.py`
- `tensorrt_llm/_torch/models/modeling_deepseekv3.py`
- `tensorrt_llm/_torch/modules/attention.py`
- `tensorrt_llm/_torch/modules/linear.py`
- `tensorrt_llm/_torch/pyexecutor/model_loader.py`
- `tensorrt_llm/_torch/utils.py`
- `tensorrt_llm/llmapi/llm_args.py`
- `tests/integration/defs/accuracy/test_llm_api_pytorch.py`
- `tests/unittest/_torch/thop/parallel/test_fp8_block_scale_gemm.py`
- `tests/unittest/api_stability/references/llm.yaml`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-10130`
