---
id: pr-sglang-16961
repo: sgl-project/sglang
pr: 16961
title: '[DeepSeek v3.2] Opt MTP decode cuda batch sizes and nsa implementation'
author: xu-yfei
date: '2026-01-19'
url: https://github.com/sgl-project/sglang/pull/16961
source_category: upstream-code
architectures:
- sm100
tags:
- FlashMLA
- attention_kv
techniques: []
hardware_features: []
kernel_types:
- attention
- decode
- mla
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: d2105d4abda6fd29e10ebc6a80b85db323b4d191
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- python/sglang/srt/layers/attention/nsa_backend.py
- python/sglang/srt/model_executor/cuda_graph_runner.py
artifact_dir: evidence/pull-bundles/sglang/gh-16961
head_ref_oid: 7adb04612c2d8043aff31900192a421f83228fb8
---
# [DeepSeek v3.2] Opt MTP decode cuda batch sizes and nsa implementation

- Repository: `sgl-project/sglang`
- PR: [16961](https://github.com/sgl-project/sglang/pull/16961)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `python/sglang/srt/layers/attention/nsa_backend.py`
- `python/sglang/srt/model_executor/cuda_graph_runner.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-16961`
