---
id: pr-flashinfer-1321
repo: flashinfer-ai/flashinfer
pr: 1321
title: Optimizations for TRTLLM MNNVL Allreduce
author: timlee0212
date: '2025-07-25'
url: https://github.com/flashinfer-ai/flashinfer/pull/1321
source_category: upstream-code
architectures:
- sm100
tags:
- gemm
techniques: []
hardware_features: []
kernel_types: []
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: 43e08e9b0fa58b4d51998ce20ca439771c8ac200
inclusion_reason: kernel file changes
changed_paths:
- csrc/trtllm_mnnvl_allreduce.cu
- flashinfer/comm/mnnvl.py
- flashinfer/comm/trtllm_mnnvl_ar.py
- include/flashinfer/comm/trtllm_mnnvl_allreduce.cuh
- tests/test_trtllm_mnnvl_allreduce.py
head_ref_oid: 2ad7c76f872dd37c70932e8cce047ed4a5b48231
artifact_dir: evidence/pull-bundles/flashinfer/gh-1321
---
# Optimizations for TRTLLM MNNVL Allreduce

- Repository: `flashinfer-ai/flashinfer`
- PR: [1321](https://github.com/flashinfer-ai/flashinfer/pull/1321)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/trtllm_mnnvl_allreduce.cu`
- `flashinfer/comm/mnnvl.py`
- `flashinfer/comm/trtllm_mnnvl_ar.py`
- `include/flashinfer/comm/trtllm_mnnvl_allreduce.cuh`
- `tests/test_trtllm_mnnvl_allreduce.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1321`
