---
id: pr-flashinfer-2074
repo: flashinfer-ai/flashinfer
pr: 2074
title: MNNVL All Reduce for large number of tokens
author: nvmbreughe
date: '2025-11-14'
url: https://github.com/flashinfer-ai/flashinfer/pull/2074
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: ba8f3ed98ab27f0821124ba2278824cdba83478a
inclusion_reason: include
changed_paths:
- flashinfer/comm/trtllm_mnnvl_ar.py
- tests/comm/test_trtllm_mnnvl_allreduce.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-2074
head_ref_oid: f52d0a171a55d46771b642fd2b90917e10321582
---
# MNNVL All Reduce for large number of tokens

- Repository: `flashinfer-ai/flashinfer`
- PR: [2074](https://github.com/flashinfer-ai/flashinfer/pull/2074)
- Decision: `include`
- Reason: include

## Changed Paths

- `flashinfer/comm/trtllm_mnnvl_ar.py`
- `tests/comm/test_trtllm_mnnvl_allreduce.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2074`
