---
id: pr-sglang-24925
repo: sgl-project/sglang
pr: 24925
title: '[attn backend] Integrate tokenspeed_mla prefill/decode kernels (fp8 kv cache, blackwell)'
author: Qiaolin-Yu
date: '2026-05-14'
url: https://github.com/sgl-project/sglang/pull/24925
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- blackwell
- fp8
techniques:
- cache-policy
hardware_features:
- blackwell
- fp8
kernel_types:
- attention
- decode
- mla
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 7618ad707568416a86a41b3c438f782486cf6fd9
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- python/pyproject.toml
- python/sglang/srt/layers/attention/attention_registry.py
- python/sglang/srt/layers/attention/tokenspeed_mla_backend.py
- python/sglang/srt/layers/attention/trtllm_mla_backend.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/models/deepseek_common/attention_backend_handler.py
- python/sglang/srt/models/deepseek_common/attention_forward_methods/forward_mla.py
- python/sglang/srt/models/deepseek_common/utils.py
- python/sglang/srt/server_args.py
- python/sglang/srt/speculative/draft_utils.py
- python/sglang/srt/utils/common.py
artifact_dir: evidence/pull-bundles/sglang/gh-24925
head_ref_oid: 3cffea7448f2e03ad8f1e1a7b2b3fb6e40eed5df
---
# [attn backend] Integrate tokenspeed_mla prefill/decode kernels (fp8 kv cache, blackwell)

- Repository: `sgl-project/sglang`
- PR: [24925](https://github.com/sgl-project/sglang/pull/24925)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `python/pyproject.toml`
- `python/sglang/srt/layers/attention/attention_registry.py`
- `python/sglang/srt/layers/attention/tokenspeed_mla_backend.py`
- `python/sglang/srt/layers/attention/trtllm_mla_backend.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/models/deepseek_common/attention_backend_handler.py`
- `python/sglang/srt/models/deepseek_common/attention_forward_methods/forward_mla.py`
- `python/sglang/srt/models/deepseek_common/utils.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/srt/speculative/draft_utils.py`
- `python/sglang/srt/utils/common.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-24925`
