---
id: pr-tilelang-1976
repo: tile-ai/tilelang
pr: 1976
title: '[Feature] Batched AllReduce for better T.reduce performance'
author: kurisu6912
date: '2026-04-28'
url: https://github.com/tile-ai/tilelang/pull/1976
source_category: upstream-code
architectures:
- sm90
tags:
- MLA
- benchmark_test
- compiler_runtime
- copy lowering
- cuda backend
- fp8
- hopper
- memory_primitives
- moe_routing
techniques:
- warp-specialization
hardware_features:
- fp8
- hopper
kernel_types:
- compiler
- memory
- mla
- moe
- reduction
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 6548c05f0c7deca6b33827c41aad4d4a6f3481b2
inclusion_reason: 'Treat compiler/runtime integration as part of the kernel: launch wrapper, cache/JIT behavior, generated code, and build flags need tests.'
changed_paths:
- src/op/finalize_reducer.cc
- src/op/finalize_reducer.h
- src/op/reduce.cc
- src/op/reduce.h
- src/target/codegen_hip.cc
- src/tl_templates/cuda/reduce.h
- src/tl_templates/hip/reduce.h
- testing/python/language/test_tilelang_language_reduce.py
- tilelang/contrib/cutedsl/reduce.py
- tilelang/language/reduce_op.py
artifact_dir: evidence/pull-bundles/tilelang/gh-1976
head_ref_oid: 4466a6b6fd2cae72ff8868fd27c6f52c8e798f80
---
# [Feature] Batched AllReduce for better T.reduce performance

- Repository: `tile-ai/tilelang`
- PR: [1976](https://github.com/tile-ai/tilelang/pull/1976)
- Decision: `Treat compiler/runtime integration as part of the kernel: launch wrapper, cache/JIT behavior, generated code, and build flags need tests.`
- Reason: Treat compiler/runtime integration as part of the kernel: launch wrapper, cache/JIT behavior, generated code, and build flags need tests.

## Changed Paths

- `src/op/finalize_reducer.cc`
- `src/op/finalize_reducer.h`
- `src/op/reduce.cc`
- `src/op/reduce.h`
- `src/target/codegen_hip.cc`
- `src/tl_templates/cuda/reduce.h`
- `src/tl_templates/hip/reduce.h`
- `testing/python/language/test_tilelang_language_reduce.py`
- `tilelang/contrib/cutedsl/reduce.py`
- `tilelang/language/reduce_op.py`

## Evidence Bundle

`evidence/pull-bundles/tilelang/gh-1976`
