---
id: pr-flashinfer-1213
repo: flashinfer-ai/flashinfer
pr: 1213
title: '[comm] TRT-LLM''s Multi-Node NVLink All-Reduce Kernel'
author: nvmbreughe
date: '2025-07-11'
url: https://github.com/flashinfer-ai/flashinfer/pull/1213
source_category: upstream-code
architectures:
- sm100
tags:
- gemm
techniques: []
hardware_features: []
kernel_types:
- gemm
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: a03c2909dc5c64c7d683b532f6dbcfa61dfa18b6
inclusion_reason: kernel file changes
changed_paths:
- csrc/trtllm_mnnvl_allreduce.cu
- flashinfer/comm/__init__.py
- flashinfer/comm/mnnvl.py
- flashinfer/comm/trtllm_mnnvl_ar.py
- include/flashinfer/comm/trtllm_mnnvl_allreduce.cuh
- tests/test_trtllm_mnnvl_allreduce.py
head_ref_oid: 70ee77311bd8ff6f7b7fea9b9452dc48ee8086e2
artifact_dir: evidence/pull-bundles/flashinfer/gh-1213
---
# [comm] TRT-LLM's Multi-Node NVLink All-Reduce Kernel

- Repository: `flashinfer-ai/flashinfer`
- PR: [1213](https://github.com/flashinfer-ai/flashinfer/pull/1213)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/trtllm_mnnvl_allreduce.cu`
- `flashinfer/comm/__init__.py`
- `flashinfer/comm/mnnvl.py`
- `flashinfer/comm/trtllm_mnnvl_ar.py`
- `include/flashinfer/comm/trtllm_mnnvl_allreduce.cuh`
- `tests/test_trtllm_mnnvl_allreduce.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1213`
