---
id: pr-sglang-21325
repo: sgl-project/sglang
pr: 21325
title: '[misc] clean up kernel API'
author: DarkSharpness
date: '2026-03-25'
url: https://github.com/sgl-project/sglang/pull/21325
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- flash-attention
- fp4
- fp8
- kernel-fusion
- moe
- nvfp4
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- attention
- flash-attention
- moe
- quantization
languages:
- python
- triton
captured_at: '2026-04-17'
status: merged
merge_sha: dfc15b78b09f713c9fb624dea393847fbbd9b491
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/jit_kernel/all_reduce.py
- python/sglang/jit_kernel/awq_marlin_repack.py
- python/sglang/jit_kernel/debug_utils.py
- python/sglang/jit_kernel/diffusion/triton/rmsnorm_onepass.py
- python/sglang/jit_kernel/flash_attention_v4.py
- python/sglang/jit_kernel/fused_store_index_cache.py
- python/sglang/jit_kernel/gptq_marlin.py
- python/sglang/jit_kernel/gptq_marlin_repack.py
- python/sglang/jit_kernel/hicache.py
- python/sglang/jit_kernel/kvcache.py
- python/sglang/jit_kernel/moe_wna16_marlin.py
- python/sglang/jit_kernel/ngram_embedding.py
- python/sglang/jit_kernel/norm.py
- python/sglang/jit_kernel/nvfp4.py
- python/sglang/jit_kernel/per_tensor_quant_fp8.py
- python/sglang/jit_kernel/per_token_group_quant_8bit.py
- python/sglang/jit_kernel/rope.py
- python/sglang/jit_kernel/timestep_embedding.py
- python/sglang/kernel_api_logging.py
- python/sglang/multimodal_gen/runtime/layers/utils.py
- python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py
- python/sglang/srt/layers/quantization/bitsandbytes.py
- python/sglang/srt/layers/quantization/fp8.py
- python/sglang/srt/layers/quantization/marlin_utils_fp8.py
- python/sglang/srt/mem_cache/memory_pool.py
- python/sglang/srt/utils/common.py
- python/sglang/srt/utils/custom_op.py
artifact_dir: evidence/pull-bundles/sglang/gh-21325
head_ref_oid: 9251aa4753e143edbcb0750f2a518f2e2206d35b
---
# [misc] clean up kernel API

- Repository: `sgl-project/sglang`
- PR: [21325](https://github.com/sgl-project/sglang/pull/21325)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/jit_kernel/all_reduce.py`
- `python/sglang/jit_kernel/awq_marlin_repack.py`
- `python/sglang/jit_kernel/debug_utils.py`
- `python/sglang/jit_kernel/diffusion/triton/rmsnorm_onepass.py`
- `python/sglang/jit_kernel/flash_attention_v4.py`
- `python/sglang/jit_kernel/fused_store_index_cache.py`
- `python/sglang/jit_kernel/gptq_marlin.py`
- `python/sglang/jit_kernel/gptq_marlin_repack.py`
- `python/sglang/jit_kernel/hicache.py`
- `python/sglang/jit_kernel/kvcache.py`
- `python/sglang/jit_kernel/moe_wna16_marlin.py`
- `python/sglang/jit_kernel/ngram_embedding.py`
- `python/sglang/jit_kernel/norm.py`
- `python/sglang/jit_kernel/nvfp4.py`
- `python/sglang/jit_kernel/per_tensor_quant_fp8.py`
- `python/sglang/jit_kernel/per_token_group_quant_8bit.py`
- `python/sglang/jit_kernel/rope.py`
- `python/sglang/jit_kernel/timestep_embedding.py`
- `python/sglang/kernel_api_logging.py`
- `python/sglang/multimodal_gen/runtime/layers/utils.py`
- `python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py`
- `python/sglang/srt/layers/quantization/bitsandbytes.py`
- `python/sglang/srt/layers/quantization/fp8.py`
- `python/sglang/srt/layers/quantization/marlin_utils_fp8.py`
- `python/sglang/srt/mem_cache/memory_pool.py`
- `python/sglang/srt/utils/common.py`
- `python/sglang/srt/utils/custom_op.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-21325`
