---
id: pr-vllm-7174
repo: vllm-project/vllm
pr: 7174
title: '[Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel '
author: LucasWilkinson
date: '2024-08-20'
url: https://github.com/vllm-project/vllm/pull/7174
source_category: upstream-code
architectures:
- sm90
tags:
- Machete
- arch_pipeline
- benchmark_test
- gemm_quant
techniques:
- fine-grained-quantization
- pipeline-stages
hardware_features:
- hopper
kernel_types:
- gemm
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 5288c06aa03b100eab4f873452b65da941a1a232
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- .gitignore
- CMakeLists.txt
- benchmarks/kernels/benchmark_machete.py
- benchmarks/kernels/graph_machete_bench.py
- benchmarks/kernels/weight_shapes.py
- csrc/cuda_utils.h
- csrc/cutlass_extensions/cute_utils.cuh
- csrc/cutlass_extensions/torch_utils.hpp
- csrc/cutlass_extensions/vllm_collective_builder.cuh
- csrc/cutlass_extensions/vllm_custom_types.cuh
- csrc/cutlass_extensions/vllm_cutlass_library_extension.py
- csrc/cutlass_extensions/vllm_numeric_conversion.cuh
- csrc/ops.h
- csrc/quantization/machete/Readme.md
- csrc/quantization/machete/generate.py
- csrc/quantization/machete/machete_collective_builder.cuh
- csrc/quantization/machete/machete_interleaving_utils.cuh
- csrc/quantization/machete/machete_mainloop.cuh
- csrc/quantization/machete/machete_mm_kernel.cuh
- csrc/quantization/machete/machete_mm_launcher.cuh
- csrc/quantization/machete/machete_prepack_kernel.cuh
- csrc/quantization/machete/machete_prepack_launcher.cuh
- csrc/quantization/machete/machete_prepacked_layout.cuh
- csrc/quantization/machete/machete_pytorch.cu
- csrc/torch_bindings.cpp
- tests/kernels/test_machete_gemm.py
- vllm/_custom_ops.py
- vllm/model_executor/layers/quantization/utils/quant_utils.py
artifact_dir: evidence/pull-bundles/vllm/gh-7174
head_ref_oid: 228789382ce0fb1ff5329819ddabd56b6253a0b1
---
# [Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel 

- Repository: `vllm-project/vllm`
- PR: [7174](https://github.com/vllm-project/vllm/pull/7174)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `.gitignore`
- `CMakeLists.txt`
- `benchmarks/kernels/benchmark_machete.py`
- `benchmarks/kernels/graph_machete_bench.py`
- `benchmarks/kernels/weight_shapes.py`
- `csrc/cuda_utils.h`
- `csrc/cutlass_extensions/cute_utils.cuh`
- `csrc/cutlass_extensions/torch_utils.hpp`
- `csrc/cutlass_extensions/vllm_collective_builder.cuh`
- `csrc/cutlass_extensions/vllm_custom_types.cuh`
- `csrc/cutlass_extensions/vllm_cutlass_library_extension.py`
- `csrc/cutlass_extensions/vllm_numeric_conversion.cuh`
- `csrc/ops.h`
- `csrc/quantization/machete/Readme.md`
- `csrc/quantization/machete/generate.py`
- `csrc/quantization/machete/machete_collective_builder.cuh`
- `csrc/quantization/machete/machete_interleaving_utils.cuh`
- `csrc/quantization/machete/machete_mainloop.cuh`
- `csrc/quantization/machete/machete_mm_kernel.cuh`
- `csrc/quantization/machete/machete_mm_launcher.cuh`
- `csrc/quantization/machete/machete_prepack_kernel.cuh`
- `csrc/quantization/machete/machete_prepack_launcher.cuh`
- `csrc/quantization/machete/machete_prepacked_layout.cuh`
- `csrc/quantization/machete/machete_pytorch.cu`
- `csrc/torch_bindings.cpp`
- `tests/kernels/test_machete_gemm.py`
- `vllm/_custom_ops.py`
- `vllm/model_executor/layers/quantization/utils/quant_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-7174`
