---
id: pr-flashinfer-1134
repo: flashinfer-ai/flashinfer
pr: 1134
title: MNNVL MoE All-to-All Support
author: cyx-6
date: '2025-06-24'
url: https://github.com/flashinfer-ai/flashinfer/pull/1134
source_category: upstream-code
architectures:
- sm100
tags:
- moe
techniques: []
hardware_features: []
kernel_types:
- moe
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: 3dd4f03df834c68873d4871e55de82db409223e2
inclusion_reason: kernel file changes
changed_paths:
- csrc/comm_pybind.cu
- csrc/trtllm_alltoall.cu
- csrc/vllm_custom_all_reduce.cu
- flashinfer/comm/__init__.py
- flashinfer/comm/cuda_ipc.py
- flashinfer/comm/dlpack_utils.py
- flashinfer/comm/mapping.py
- flashinfer/comm/mnnvl.py
- flashinfer/comm/trtllm_alltoall.py
- flashinfer/comm/trtllm_ar.py
- flashinfer/comm/vllm_ar.py
- flashinfer/cuda_utils.py
- flashinfer/green_ctx.py
- include/flashinfer/comm/trtllm_alltoall.cuh
- include/flashinfer/comm/vllm_custom_all_reduce.cuh
- setup.py
- tests/test_mnnvl_memory.py
- tests/test_trtllm_alltoall.py
- tests/test_vllm_custom_allreduce.py
head_ref_oid: 6986ee843a08a0fc5cc335fa8adf5dd5ef9a8cda
artifact_dir: evidence/pull-bundles/flashinfer/gh-1134
---
# MNNVL MoE All-to-All Support

- Repository: `flashinfer-ai/flashinfer`
- PR: [1134](https://github.com/flashinfer-ai/flashinfer/pull/1134)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/comm_pybind.cu`
- `csrc/trtllm_alltoall.cu`
- `csrc/vllm_custom_all_reduce.cu`
- `flashinfer/comm/__init__.py`
- `flashinfer/comm/cuda_ipc.py`
- `flashinfer/comm/dlpack_utils.py`
- `flashinfer/comm/mapping.py`
- `flashinfer/comm/mnnvl.py`
- `flashinfer/comm/trtllm_alltoall.py`
- `flashinfer/comm/trtllm_ar.py`
- `flashinfer/comm/vllm_ar.py`
- `flashinfer/cuda_utils.py`
- `flashinfer/green_ctx.py`
- `include/flashinfer/comm/trtllm_alltoall.cuh`
- `include/flashinfer/comm/vllm_custom_all_reduce.cuh`
- `setup.py`
- `tests/test_mnnvl_memory.py`
- `tests/test_trtllm_alltoall.py`
- `tests/test_vllm_custom_allreduce.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1134`
