---
id: pr-vllm-41778
repo: vllm-project/vllm
pr: 41778
title: '[MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 prefill + decode on Blackwell'
author: zyongye
date: '2026-05-14'
url: https://github.com/vllm-project/vllm/pull/41778
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- benchmark kernel
- benchmark_test
- blackwell
- sm100
techniques:
- cache-policy
hardware_features:
- blackwell
- fp8
kernel_types:
- attention
- decode
- mla
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 0d2732dd919b2cdb979923144180bda32d6bf57f
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- benchmarks/attention_benchmarks/configs/mla_decode.yaml
- benchmarks/attention_benchmarks/configs/mla_prefill.yaml
- benchmarks/attention_benchmarks/mla_runner.py
- docs/design/attention_backends.md
- requirements/cuda.txt
- tests/conftest.py
- tests/v1/attention/test_mla_backends.py
- vllm/model_executor/layers/attention/mla_attention.py
- vllm/platforms/cuda.py
- vllm/v1/attention/backends/mla/prefill/registry.py
- vllm/v1/attention/backends/mla/prefill/selector.py
- vllm/v1/attention/backends/mla/prefill/tokenspeed_mla.py
- vllm/v1/attention/backends/mla/tokenspeed_mla.py
- vllm/v1/attention/backends/registry.py
artifact_dir: evidence/pull-bundles/vllm/gh-41778
head_ref_oid: 7d0361656e3f41373d5a55ff7a5c211ac6cc84c9
---
# [MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 prefill + decode on Blackwell

- Repository: `vllm-project/vllm`
- PR: [41778](https://github.com/vllm-project/vllm/pull/41778)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `benchmarks/attention_benchmarks/configs/mla_decode.yaml`
- `benchmarks/attention_benchmarks/configs/mla_prefill.yaml`
- `benchmarks/attention_benchmarks/mla_runner.py`
- `docs/design/attention_backends.md`
- `requirements/cuda.txt`
- `tests/conftest.py`
- `tests/v1/attention/test_mla_backends.py`
- `vllm/model_executor/layers/attention/mla_attention.py`
- `vllm/platforms/cuda.py`
- `vllm/v1/attention/backends/mla/prefill/registry.py`
- `vllm/v1/attention/backends/mla/prefill/selector.py`
- `vllm/v1/attention/backends/mla/prefill/tokenspeed_mla.py`
- `vllm/v1/attention/backends/mla/tokenspeed_mla.py`
- `vllm/v1/attention/backends/registry.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41778`
