---
id: pr-cutlass-2095
repo: NVIDIA/cutlass
pr: 2095
title: 'Improvements for: Groupwise scaling along M for FP8 gemm'
author: LucasWilkinson
date: '2025-02-28'
url: https://github.com/NVIDIA/cutlass/pull/2095
source_category: upstream-code
architectures:
- sm90
tags:
- arch_pipeline
- fp8
- gemm_quant
- hopper
- sm90
- tma
techniques:
- async-copy
- fine-grained-quantization
- pipeline-stages
- warp-specialization
hardware_features:
- fp8
- hopper
- tma
kernel_types:
- gemm
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: df18f5e4f5de76bed8be1de8e4c245f2f5ec3020
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling.cu
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_groupwise_scaling.cu
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/reference/host/gemm_with_groupwise_scaling.h
- include/cutlass/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp
artifact_dir: evidence/pull-bundles/cutlass/gh-2095
head_ref_oid: 460b938ab6f426e51823077675c441caeae3b263
---
# Improvements for: Groupwise scaling along M for FP8 gemm

- Repository: `NVIDIA/cutlass`
- PR: [2095](https://github.com/NVIDIA/cutlass/pull/2095)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling.cu`
- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_groupwise_scaling.cu`
- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/reference/host/gemm_with_groupwise_scaling.h`
- `include/cutlass/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp`

## Evidence Bundle

`evidence/pull-bundles/cutlass/gh-2095`
