---
id: pr-vllm-23280
repo: vllm-project/vllm
pr: 23280
title: '[Perf] Use upstream CUTLASS for SM90 Block FP8 kernel'
author: mgoin
date: '2025-09-11'
url: https://github.com/vllm-project/vllm/pull/23280
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- fp8
- gemm
- quantization
- tma
techniques: []
hardware_features:
- fp8
- tma
kernel_types:
- gemm
- quantization
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: c3aea10dc8b83645523843a27999a95340020ddf
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/kernels/bench_block_fp8_gemm.py
- csrc/cutlass_extensions/gemm/collective/collective_builder.hpp
- csrc/cutlass_extensions/gemm/collective/fp8_accumulation.hpp
- csrc/cutlass_extensions/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp
- csrc/cutlass_extensions/gemm/dispatch_policy.hpp
- csrc/cutlass_extensions/vllm_collective_builder.cuh
- csrc/quantization/cutlass_w8a8/c3x/scaled_mm_blockwise_sm100_fp8_dispatch.cuh
- csrc/quantization/cutlass_w8a8/c3x/scaled_mm_blockwise_sm120_fp8_dispatch.cuh
- csrc/quantization/cutlass_w8a8/c3x/scaled_mm_blockwise_sm90_fp8_dispatch.cuh
- csrc/quantization/cutlass_w8a8/c3x/scaled_mm_helper.hpp
- tests/kernels/quantization/test_block_fp8.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
head_ref_oid: f3b65e7678f23601782a56bb856b765aa633c4e4
artifact_dir: evidence/pull-bundles/vllm/gh-23280
---
# [Perf] Use upstream CUTLASS for SM90 Block FP8 kernel

- Repository: `vllm-project/vllm`
- PR: [23280](https://github.com/vllm-project/vllm/pull/23280)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/kernels/bench_block_fp8_gemm.py`
- `csrc/cutlass_extensions/gemm/collective/collective_builder.hpp`
- `csrc/cutlass_extensions/gemm/collective/fp8_accumulation.hpp`
- `csrc/cutlass_extensions/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp`
- `csrc/cutlass_extensions/gemm/dispatch_policy.hpp`
- `csrc/cutlass_extensions/vllm_collective_builder.cuh`
- `csrc/quantization/cutlass_w8a8/c3x/scaled_mm_blockwise_sm100_fp8_dispatch.cuh`
- `csrc/quantization/cutlass_w8a8/c3x/scaled_mm_blockwise_sm120_fp8_dispatch.cuh`
- `csrc/quantization/cutlass_w8a8/c3x/scaled_mm_blockwise_sm90_fp8_dispatch.cuh`
- `csrc/quantization/cutlass_w8a8/c3x/scaled_mm_helper.hpp`
- `tests/kernels/quantization/test_block_fp8.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-23280`
