---
id: pr-sglang-20479
repo: sgl-project/sglang
pr: 20479
title: Support Triton MLA FP8 KV cache
author: b8zhong
date: '2026-05-07'
url: https://github.com/sgl-project/sglang/pull/20479
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- PDL
- attention_kv
- compiler_runtime
- sm90
techniques:
- cache-policy
hardware_features:
- fp8
- hopper
- pdl
kernel_types:
- attention
- compiler
- decode
- mla
languages:
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 3fe8bc987e0d474e1ef056d21c3a3b7695f95660
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- python/sglang/srt/layers/attention/triton_backend.py
- python/sglang/srt/layers/attention/triton_ops/decode_attention.py
- python/sglang/srt/layers/attention/triton_ops/extend_attention.py
artifact_dir: evidence/pull-bundles/sglang/gh-20479
head_ref_oid: ef29aa8959dba8913de3458767da6c677671bec2
---
# Support Triton MLA FP8 KV cache

- Repository: `sgl-project/sglang`
- PR: [20479](https://github.com/sgl-project/sglang/pull/20479)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `python/sglang/srt/layers/attention/triton_backend.py`
- `python/sglang/srt/layers/attention/triton_ops/decode_attention.py`
- `python/sglang/srt/layers/attention/triton_ops/extend_attention.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-20479`
