---
id: pr-sglang-5086
repo: sgl-project/sglang
pr: 5086
title: reduce moe_align_block_size_kernel small batch mode overhead
author: BBuf
date: '2025-04-10'
url: https://github.com/sgl-project/sglang/pull/5086
source_category: upstream-code
architectures:
- sm100
tags:
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- moe
languages:
- cuda-cpp
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: f730362ee207ae8af892e6924d9c811c383dda47
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py
- sgl-kernel/benchmark/bench_moe_align_block_size.py
- sgl-kernel/csrc/moe/moe_align_kernel.cu
- sgl-kernel/tests/test_moe_align.py
head_ref_oid: 6e5669619db6b20839c4f60abc9ede0e79354ba6
artifact_dir: evidence/pull-bundles/sglang/gh-5086
---
# reduce moe_align_block_size_kernel small batch mode overhead

- Repository: `sgl-project/sglang`
- PR: [5086](https://github.com/sgl-project/sglang/pull/5086)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py`
- `sgl-kernel/benchmark/bench_moe_align_block_size.py`
- `sgl-kernel/csrc/moe/moe_align_kernel.cu`
- `sgl-kernel/tests/test_moe_align.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-5086`
