---
id: pr-vllm-32619
repo: vllm-project/vllm
pr: 32619
title: '[Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper'
author: xyang16
date: '2026-01-22'
url: https://github.com/vllm-project/vllm/pull/32619
source_category: upstream-code
architectures:
- sm90
tags:
- DeepGEMM
- arch_pipeline
- benchmark_test
- gemm_quant
- hopper
- sm90
techniques:
- async-copy
- fine-grained-quantization
- pipeline-stages
hardware_features:
- fp8
- hopper
- tma
kernel_types:
- gemm
- runtime
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: d08b356ee08dc8e0b0dd052ed7bef5245e21d7af
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- benchmarks/kernels/deepgemm/benchmark_fp8_block_dense_gemm.py
- tests/kernels/quant_utils.py
- tests/kernels/quantization/test_block_fp8.py
- tests/kernels/quantization/test_per_token_group_quant.py
- vllm/model_executor/layers/quantization/input_quant_fp8.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
- vllm/utils/deep_gemm.py
artifact_dir: evidence/pull-bundles/vllm/gh-32619
head_ref_oid: 4c7d0530999624687d487fb74d50783fbc135fee
---
# [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper

- Repository: `vllm-project/vllm`
- PR: [32619](https://github.com/vllm-project/vllm/pull/32619)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `benchmarks/kernels/deepgemm/benchmark_fp8_block_dense_gemm.py`
- `tests/kernels/quant_utils.py`
- `tests/kernels/quantization/test_block_fp8.py`
- `tests/kernels/quantization/test_per_token_group_quant.py`
- `vllm/model_executor/layers/quantization/input_quant_fp8.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`
- `vllm/utils/deep_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-32619`
