---
id: pr-sglang-6929
repo: sgl-project/sglang
pr: 6929
title: '[perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128'
author: Alcanderian
date: '2025-06-09'
url: https://github.com/sgl-project/sglang/pull/6929
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- decode
- flash-attention
- mla
- tile-scheduling
- tma
techniques:
- tile-scheduling
hardware_features:
- tma
kernel_types:
- attention
- decode
- flash-attention
- mla
languages:
- cuda-cpp
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 18efb5e8e0ed467f6dc42680d88787f5ed6c074e
inclusion_reason: kernel file changes
changed_paths:
- sgl-kernel/benchmark/bench_cutlass_mla.py
- sgl-kernel/csrc/attention/cutlass_mla_kernel.cu
- sgl-kernel/csrc/attention/cutlass_sm100_mla/device/sm100_mla.hpp
- sgl-kernel/csrc/attention/cutlass_sm100_mla/kernel/sm100_fmha_mla_reduction.hpp
- sgl-kernel/csrc/attention/cutlass_sm100_mla/kernel/sm100_fmha_mla_tma_warpspecialized.hpp
- sgl-kernel/csrc/attention/cutlass_sm100_mla/kernel/sm100_mla_tile_scheduler.hpp
- sgl-kernel/csrc/common_extension.cc
- sgl-kernel/include/sgl_kernel_ops.h
- sgl-kernel/python/sgl_kernel/attention.py
- sgl-kernel/tests/test_cutlass_mla.py
head_ref_oid: f830da4c3a62f9f77526ac6b07f48bdaeef0fc6e
artifact_dir: evidence/pull-bundles/sglang/gh-6929
---
# [perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128

- Repository: `sgl-project/sglang`
- PR: [6929](https://github.com/sgl-project/sglang/pull/6929)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `sgl-kernel/benchmark/bench_cutlass_mla.py`
- `sgl-kernel/csrc/attention/cutlass_mla_kernel.cu`
- `sgl-kernel/csrc/attention/cutlass_sm100_mla/device/sm100_mla.hpp`
- `sgl-kernel/csrc/attention/cutlass_sm100_mla/kernel/sm100_fmha_mla_reduction.hpp`
- `sgl-kernel/csrc/attention/cutlass_sm100_mla/kernel/sm100_fmha_mla_tma_warpspecialized.hpp`
- `sgl-kernel/csrc/attention/cutlass_sm100_mla/kernel/sm100_mla_tile_scheduler.hpp`
- `sgl-kernel/csrc/common_extension.cc`
- `sgl-kernel/include/sgl_kernel_ops.h`
- `sgl-kernel/python/sgl_kernel/attention.py`
- `sgl-kernel/tests/test_cutlass_mla.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-6929`
