---
id: pr-sglang-6109
repo: sgl-project/sglang
pr: 6109
title: '[Feat] Support FlashMLA backend with MTP and FP8 KV cache'
author: quinnrong94
date: '2025-05-15'
url: https://github.com/sgl-project/sglang/pull/6109
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 2e4babdb0a19fd3bd5a863cba083d36c17506b40
inclusion_reason: defer
changed_paths:
- docs/backend/attention_backend.md
- docs/references/deepseek.md
- python/sglang/srt/layers/attention/flashinfer_mla_backend.py
- python/sglang/srt/layers/attention/flashmla_backend.py
- python/sglang/srt/layers/attention/utils.py
- python/sglang/srt/model_executor/cuda_graph_runner.py
- python/sglang/srt/speculative/eagle_worker.py
- test/srt/test_flashmla.py
artifact_dir: evidence/pull-bundles/sglang/gh-6109
head_ref_oid: 0259eb6ebc099e08cdbdcfa5629da89b95180a3e
---
# [Feat] Support FlashMLA backend with MTP and FP8 KV cache

- Repository: `sgl-project/sglang`
- PR: [6109](https://github.com/sgl-project/sglang/pull/6109)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `docs/backend/attention_backend.md`
- `docs/references/deepseek.md`
- `python/sglang/srt/layers/attention/flashinfer_mla_backend.py`
- `python/sglang/srt/layers/attention/flashmla_backend.py`
- `python/sglang/srt/layers/attention/utils.py`
- `python/sglang/srt/model_executor/cuda_graph_runner.py`
- `python/sglang/srt/speculative/eagle_worker.py`
- `test/srt/test_flashmla.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-6109`
