---
id: pr-cutlass-1883
repo: NVIDIA/cutlass
pr: 1883
title: Improve sm90 mixed dtype kernel
author: sklevtsov-nvidia
date: '2024-10-18'
url: https://github.com/NVIDIA/cutlass/pull/1883
source_category: upstream-code
architectures:
- sm90
tags:
- arch_pipeline
- gemm_quant
- sm90
techniques:
- async-copy
- epilogue-fusion
- fine-grained-quantization
- pipeline-stages
- warp-specialization
hardware_features:
- fp8
- hopper
- tma
kernel_types:
- gemm
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 08101d9d0ca68fbdd4ed8833a9fa66dc3948b77d
inclusion_reason: 'Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.'
changed_paths:
- examples/55_hopper_mixed_dtype_gemm/55_hopper_int4_bf16_gemm.cu
- examples/55_hopper_mixed_dtype_gemm/55_hopper_int4_fp8_gemm.cu
- examples/55_hopper_mixed_dtype_gemm/CMakeLists.txt
- examples/55_hopper_mixed_dtype_gemm/packed_scale.hpp
- examples/55_hopper_mixed_dtype_gemm/reorder_utils.hpp
- include/cute/algorithm/tuple_algorithms.hpp
- include/cutlass/detail/layout.hpp
- include/cutlass/epilogue/collective/sm90_epilogue_tma_warpspecialized.hpp
- include/cutlass/gemm/collective/builders/sm90_gmma_builder.inl
- include/cutlass/gemm/collective/sm90_mma_tma_gmma_rs_warpspecialized_mixed_input.hpp
- include/cutlass/gemm/gemm.h
artifact_dir: evidence/pull-bundles/cutlass/gh-1883
head_ref_oid: eb54cd5a9cc3b82945bbded62e45a90e6b6b2828
---
# Improve sm90 mixed dtype kernel

- Repository: `NVIDIA/cutlass`
- PR: [1883](https://github.com/NVIDIA/cutlass/pull/1883)
- Decision: `Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.`
- Reason: Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.

## Changed Paths

- `examples/55_hopper_mixed_dtype_gemm/55_hopper_int4_bf16_gemm.cu`
- `examples/55_hopper_mixed_dtype_gemm/55_hopper_int4_fp8_gemm.cu`
- `examples/55_hopper_mixed_dtype_gemm/CMakeLists.txt`
- `examples/55_hopper_mixed_dtype_gemm/packed_scale.hpp`
- `examples/55_hopper_mixed_dtype_gemm/reorder_utils.hpp`
- `include/cute/algorithm/tuple_algorithms.hpp`
- `include/cutlass/detail/layout.hpp`
- `include/cutlass/epilogue/collective/sm90_epilogue_tma_warpspecialized.hpp`
- `include/cutlass/gemm/collective/builders/sm90_gmma_builder.inl`
- `include/cutlass/gemm/collective/sm90_mma_tma_gmma_rs_warpspecialized_mixed_input.hpp`
- `include/cutlass/gemm/gemm.h`

## Evidence Bundle

`evidence/pull-bundles/cutlass/gh-1883`
