---
id: pr-sglang-4215
repo: sgl-project/sglang
pr: 4215
title: Accelerate FP8 CUDA Kernel by 20-28%
author: hebiao064
date: '2025-03-12'
url: https://github.com/sgl-project/sglang/pull/4215
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- gemm
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: e0917e6bd0fbbbbc8ba3db48ae26f07366ab9a0c
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/custom_op.py
- python/sglang/srt/layers/moe/ep_moe/layer.py
- python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py
- python/sglang/test/test_custom_ops.py
- sgl-kernel/csrc/gemm/per_token_quant_fp8.cu
head_ref_oid: e46b9d56b2b592eb4652e6cdb395ab52594d73df
artifact_dir: evidence/pull-bundles/sglang/gh-4215
---
# Accelerate FP8 CUDA Kernel by 20-28%

- Repository: `sgl-project/sglang`
- PR: [4215](https://github.com/sgl-project/sglang/pull/4215)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/custom_op.py`
- `python/sglang/srt/layers/moe/ep_moe/layer.py`
- `python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py`
- `python/sglang/test/test_custom_ops.py`
- `sgl-kernel/csrc/gemm/per_token_quant_fp8.cu`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-4215`
