---
id: pr-vllm-41868
repo: vllm-project/vllm
pr: 41868
title: '[CUDA][CUTLASS] Enable cutlass scaled mm for non-compatible sizes '
author: johncalesp
date: '2026-05-08'
url: https://github.com/vllm-project/vllm/pull/41868
source_category: upstream-code
architectures:
- sm90
tags:
- benchmark kernel
- benchmark_test
- cutlass
- gemm_quant
- hopper
- quantization kernel
techniques:
- fine-grained-quantization
hardware_features:
- fp8
- hopper
kernel_types:
- gemm
languages:
- cuda-cpp
- cute-dsl
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 8a2fc80b848af8f1e902d4b2b14afe378d9d4d89
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tests/kernels/quantization/test_cutlass_scaled_mm.py
- vllm/model_executor/kernels/linear/scaled_mm/cutlass.py
artifact_dir: evidence/pull-bundles/vllm/gh-41868
head_ref_oid: f8eae23855968248c3e416690f5a2494cae993e0
---
# [CUDA][CUTLASS] Enable cutlass scaled mm for non-compatible sizes 

- Repository: `vllm-project/vllm`
- PR: [41868](https://github.com/vllm-project/vllm/pull/41868)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tests/kernels/quantization/test_cutlass_scaled_mm.py`
- `vllm/model_executor/kernels/linear/scaled_mm/cutlass.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41868`
