---
id: pr-cutlass-2037
repo: NVIDIA/cutlass
pr: 2037
title: Groupwise scaling along M for FP8 gemm
author: soundOfDestiny
date: '2025-01-31'
url: https://github.com/NVIDIA/cutlass/pull/2037
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- fp8
- gemm
- tma
- warp-specialization
techniques:
- warp-specialization
hardware_features:
- fp8
- tma
kernel_types:
- gemm
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: 3c28697b9f41fee4517b1758ffe83a85ac3ce2b4
inclusion_reason: kernel file changes
changed_paths:
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling.cu
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_groupwise_scaling.cu
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/CMakeLists.txt
- examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/reference/host/gemm_with_groupwise_scaling.h
- include/cutlass/gemm/collective/builders/sm90_gmma_builder.inl
- include/cutlass/gemm/collective/fp8_accumulation.hpp
- include/cutlass/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp
- include/cutlass/gemm/dispatch_policy.hpp
head_ref_oid: b4abc3f0cd76c1962055d76a2d4be406aab7df72
artifact_dir: evidence/pull-bundles/cutlass/gh-2037
---
# Groupwise scaling along M for FP8 gemm

- Repository: `NVIDIA/cutlass`
- PR: [2037](https://github.com/NVIDIA/cutlass/pull/2037)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling.cu`
- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/67_hopper_fp8_warp_specialized_gemm_with_groupwise_scaling.cu`
- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/CMakeLists.txt`
- `examples/67_hopper_fp8_warp_specialized_gemm_with_blockwise_scaling/reference/host/gemm_with_groupwise_scaling.h`
- `include/cutlass/gemm/collective/builders/sm90_gmma_builder.inl`
- `include/cutlass/gemm/collective/fp8_accumulation.hpp`
- `include/cutlass/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp`
- `include/cutlass/gemm/dispatch_policy.hpp`

## Evidence Bundle

`evidence/pull-bundles/cutlass/gh-2037`
