---
id: pr-sglang-19537
repo: sgl-project/sglang
pr: 19537
title: '[FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE'
author: zianglih
date: '2026-03-10'
url: https://github.com/sgl-project/sglang/pull/19537
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- gemm
- kernel-fusion
- moe
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- gemm
- moe
- quantization
languages:
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 76ee4bb98c64e9dc95ceb330bb12fd1cda405e17
inclusion_reason: kernel file changes
changed_paths:
- docs/advanced_features/expert_parallelism.md
- docs/advanced_features/server_arguments.md
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/moe/fused_moe_triton/layer.py
- python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py
- python/sglang/srt/layers/moe/moe_runner/runner.py
- python/sglang/srt/layers/moe/token_dispatcher/standard.py
- python/sglang/srt/layers/moe/topk.py
- python/sglang/srt/layers/moe/utils.py
- python/sglang/srt/layers/quantization/fp8.py
- python/sglang/srt/layers/quantization/fp8_utils.py
- python/sglang/srt/server_args.py
- test/registered/backends/test_flashinfer_trtllm_gen_moe_backend.py
- test/registered/quant/test_fp8_blockwise_gemm.py
head_ref_oid: 181c130e17582ec7c7773c68ab6a56684a0e9b38
artifact_dir: evidence/pull-bundles/sglang/gh-19537
---
# [FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE

- Repository: `sgl-project/sglang`
- PR: [19537](https://github.com/sgl-project/sglang/pull/19537)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `docs/advanced_features/expert_parallelism.md`
- `docs/advanced_features/server_arguments.md`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/moe/fused_moe_triton/layer.py`
- `python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py`
- `python/sglang/srt/layers/moe/moe_runner/runner.py`
- `python/sglang/srt/layers/moe/token_dispatcher/standard.py`
- `python/sglang/srt/layers/moe/topk.py`
- `python/sglang/srt/layers/moe/utils.py`
- `python/sglang/srt/layers/quantization/fp8.py`
- `python/sglang/srt/layers/quantization/fp8_utils.py`
- `python/sglang/srt/server_args.py`
- `test/registered/backends/test_flashinfer_trtllm_gen_moe_backend.py`
- `test/registered/quant/test_fp8_blockwise_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-19537`
