---
id: pr-cutlass-2123
repo: NVIDIA/cutlass
pr: 2123
title: Hopper Grouped GEMM support for FP8 Accum
author: ANIKET-SHIVAM
date: '2025-02-21'
url: https://github.com/NVIDIA/cutlass/pull/2123
source_category: upstream-code
architectures:
- sm90
tags:
- arch_pipeline
- collective builder
- fp8
- gemm_quant
- grouped gemm
- hopper
- moe_routing
techniques:
- async-copy
- fine-grained-quantization
- pipeline-stages
- warp-specialization
hardware_features:
- fp8
- hopper
- tma
kernel_types:
- gemm
- moe
- runtime
languages:
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 9b3772dfa64da305612a0e4cafc51bd1bcb3f74d
inclusion_reason: 'Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.'
changed_paths:
- .gitignore
- CONTRIBUTORS.md
- include/cutlass/gemm/collective/builders/sm90_gmma_builder.inl
- include/cutlass/gemm/collective/collective_mma.hpp
- include/cutlass/gemm/collective/sm90_mma_array_tma_gmma_ss_warpspecialized_fp8.hpp
- include/cutlass/gemm/dispatch_policy.hpp
- python/cutlass_library/library.py
- python/cutlass_library/sm90_utils.py
- tools/library/src/grouped_gemm_operation_3x.hpp
artifact_dir: evidence/pull-bundles/cutlass/gh-2123
head_ref_oid: 4bd19b460cbcba428fb3c93078915278bb1cc22f
---
# Hopper Grouped GEMM support for FP8 Accum

- Repository: `NVIDIA/cutlass`
- PR: [2123](https://github.com/NVIDIA/cutlass/pull/2123)
- Decision: `Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.`
- Reason: Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.

## Changed Paths

- `.gitignore`
- `CONTRIBUTORS.md`
- `include/cutlass/gemm/collective/builders/sm90_gmma_builder.inl`
- `include/cutlass/gemm/collective/collective_mma.hpp`
- `include/cutlass/gemm/collective/sm90_mma_array_tma_gmma_ss_warpspecialized_fp8.hpp`
- `include/cutlass/gemm/dispatch_policy.hpp`
- `python/cutlass_library/library.py`
- `python/cutlass_library/sm90_utils.py`
- `tools/library/src/grouped_gemm_operation_3x.hpp`

## Evidence Bundle

`evidence/pull-bundles/cutlass/gh-2123`
