---
id: pr-vllm-16032
repo: vllm-project/vllm
pr: 16032
title: '[NVIDIA] Support Cutlass MLA for Blackwell GPUs'
author: kaixih
date: '2025-04-27'
url: https://github.com/vllm-project/vllm/pull/16032
source_category: upstream-code
architectures:
- sm100
tags:
- tcgen05
- mla
- moe
- attention
techniques:
- warp-specialization
- persistent-kernel
hardware_features:
- tcgen05
- tmem
- tma
kernel_types:
- mla
- attention
- decode
- moe
languages:
- cuda-cpp
- python
captured_at: 2026-04-16
status: merged
merge_sha: ed7a29d9f8b48978e3bbf43599d21b4de65387e0
inclusion_reason: manually curated, Blackwell kernel relevance
changed_paths:
- CMakeLists.txt
- csrc/attention/mla/cutlass_mla_entry.cu
- csrc/attention/mla/cutlass_mla_kernels.cu
- csrc/ops.h
- csrc/quantization/fp4/nvfp4_scaled_mm_kernels.cu
- csrc/torch_bindings.cpp
- tests/kernels/test_cutlass_mla_decode.py
- vllm/_custom_ops.py
artifact_dir: evidence/pull-bundles/vllm/gh-16032
head_ref_oid: 1ed6dc31c72cb500a415fcb65ad860a01770a978
---
# [NVIDIA] Support Cutlass MLA for Blackwell GPUs

- Repository: `vllm-project/vllm`
- PR: [16032](https://github.com/vllm-project/vllm/pull/16032)
- Decision: `manually curated, Blackwell kernel relevance`
- Reason: manually curated, Blackwell kernel relevance

## Changed Paths

- `CMakeLists.txt`
- `csrc/attention/mla/cutlass_mla_entry.cu`
- `csrc/attention/mla/cutlass_mla_kernels.cu`
- `csrc/ops.h`
- `csrc/quantization/fp4/nvfp4_scaled_mm_kernels.cu`
- `csrc/torch_bindings.cpp`
- `tests/kernels/test_cutlass_mla_decode.py`
- `vllm/_custom_ops.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-16032`
