---
id: pr-sglang-12787
repo: sgl-project/sglang
pr: 12787
title: '[Nvidia] Add trtllm mnnvl allreduce with unified flashinfer allreduce fusion api'
author: wenscarl
date: '2026-03-17'
url: https://github.com/sgl-project/sglang/pull/12787
source_category: upstream-code
architectures:
- sm90
tags:
- attention_kv
- benchmark_test
- hopper
- memory_primitives
- moe_routing
- sm90
techniques:
- kernel-fusion
hardware_features:
- hopper
kernel_types:
- attention
- decode
- memory
- moe
- norm
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: d35fea1b2b8ea919396c16ddef6c84d8bc276153
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- docs/advanced_features/server_arguments.md
- python/sglang/srt/layers/communicator.py
- python/sglang/srt/layers/flashinfer_comm_fusion.py
- python/sglang/srt/server_args.py
artifact_dir: evidence/pull-bundles/sglang/gh-12787
head_ref_oid: 537d595acab09a9e8363f0b7c0b07d99e3b406d4
---
# [Nvidia] Add trtllm mnnvl allreduce with unified flashinfer allreduce fusion api

- Repository: `sgl-project/sglang`
- PR: [12787](https://github.com/sgl-project/sglang/pull/12787)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `docs/advanced_features/server_arguments.md`
- `python/sglang/srt/layers/communicator.py`
- `python/sglang/srt/layers/flashinfer_comm_fusion.py`
- `python/sglang/srt/server_args.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-12787`
