---
id: pr-vllm-21556
repo: vllm-project/vllm
pr: 21556
title: '[Kernel] Improve machete memory bound perf'
author: czhu-cohere
date: '2025-07-25'
url: https://github.com/vllm-project/vllm/pull/21556
source_category: upstream-code
architectures:
- sm100
tags:
- Machete
- benchmark_test
- gemm_quant
techniques:
- fine-grained-quantization
hardware_features: []
kernel_types:
- gemm
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 136d750f5f421ca5be2e24b0a913e813d99bb831
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- csrc/quantization/machete/machete_prepacked_layout.cuh
artifact_dir: evidence/pull-bundles/vllm/gh-21556
head_ref_oid: 6944d7d5f777b53ae900cb5aa06a45662a5a71bd
---
# [Kernel] Improve machete memory bound perf

- Repository: `vllm-project/vllm`
- PR: [21556](https://github.com/vllm-project/vllm/pull/21556)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `csrc/quantization/machete/machete_prepacked_layout.cuh`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-21556`
