---
id: pr-sglang-14122
repo: sgl-project/sglang
pr: 14122
title: Add new moe wna16 marlin gemm
author: BBuf
date: '2025-12-01'
url: https://github.com/sgl-project/sglang/pull/14122
source_category: upstream-code
architectures:
- sm100
tags:
- gemm
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 3de09aadbc032c34c1f4940b792f7f905ed19765
inclusion_reason: kernel file changes
changed_paths:
- sgl-kernel/csrc/common_extension.cc
- sgl-kernel/csrc/gemm/marlin/dequant.h
- sgl-kernel/csrc/moe/marlin_moe_wna16/generate_kernels.py
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel.h
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_bf16_ku4.cuh
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_bf16_ku4b8.cuh
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_bf16_ku8b128.cuh
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_fp16_ku4.cuh
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_fp16_ku4b8.cuh
- sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_fp16_ku8b128.cuh
- sgl-kernel/csrc/moe/marlin_moe_wna16/marlin_template.h
- sgl-kernel/csrc/moe/marlin_moe_wna16/ops.cu
- sgl-kernel/include/scalar_type.hpp
- sgl-kernel/include/sgl_kernel_ops.h
- sgl-kernel/python/sgl_kernel/fused_moe.py
head_ref_oid: e4d4ce48655590c3aaf686820580a7207f9fe388
artifact_dir: evidence/pull-bundles/sglang/gh-14122
---
# Add new moe wna16 marlin gemm

- Repository: `sgl-project/sglang`
- PR: [14122](https://github.com/sgl-project/sglang/pull/14122)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `sgl-kernel/csrc/common_extension.cc`
- `sgl-kernel/csrc/gemm/marlin/dequant.h`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/generate_kernels.py`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel.h`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_bf16_ku4.cuh`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_bf16_ku4b8.cuh`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_bf16_ku8b128.cuh`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_fp16_ku4.cuh`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_fp16_ku4b8.cuh`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/kernel_fp16_ku8b128.cuh`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/marlin_template.h`
- `sgl-kernel/csrc/moe/marlin_moe_wna16/ops.cu`
- `sgl-kernel/include/scalar_type.hpp`
- `sgl-kernel/include/sgl_kernel_ops.h`
- `sgl-kernel/python/sgl_kernel/fused_moe.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-14122`
