---
id: pr-flashinfer-1159
repo: flashinfer-ai/flashinfer
pr: 1159
title: 'feat: add finalize_moe_allreduce from trtllm'
author: yyihuang
date: '2025-06-22'
url: https://github.com/flashinfer-ai/flashinfer/pull/1159
source_category: upstream-code
architectures:
- sm100
tags:
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- moe
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: ba2470c51ffb5ef531ad5fa277621222c54cd1c4
inclusion_reason: kernel file changes
changed_paths:
- csrc/trtllm_moe_allreduce_fusion.cu
- flashinfer/comm.py
- include/flashinfer/comm/trtllm_allreduce.cuh
- include/flashinfer/comm/trtllm_moe_allreduce_fusion.cuh
- tests/test_trtllm_moe_allreduce_fusion_finalize.py
head_ref_oid: a41258b5761bd94fcc52db38a9122a6f5e4d153e
artifact_dir: evidence/pull-bundles/flashinfer/gh-1159
---
# feat: add finalize_moe_allreduce from trtllm

- Repository: `flashinfer-ai/flashinfer`
- PR: [1159](https://github.com/flashinfer-ai/flashinfer/pull/1159)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/trtllm_moe_allreduce_fusion.cu`
- `flashinfer/comm.py`
- `include/flashinfer/comm/trtllm_allreduce.cuh`
- `include/flashinfer/comm/trtllm_moe_allreduce_fusion.cuh`
- `tests/test_trtllm_moe_allreduce_fusion_finalize.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1159`
