---
id: pr-sglang-3899
repo: sgl-project/sglang
pr: 3899
title: Support FP4 gemm (1/2)
author: trevor-m
date: '2025-03-25'
url: https://github.com/sgl-project/sglang/pull/3899
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- gemm
- nvfp4
- quantization
techniques: []
hardware_features:
- fp4
- nvfp4
kernel_types:
- gemm
- quantization
languages:
- cuda-cpp
- python
captured_at: '2026-04-27'
status: merged
merge_sha: e9f8e423189070d3b223457303ddce8ccb9ce1e7
inclusion_reason: kernel file changes
changed_paths:
- sgl-kernel/csrc/gemm/nvfp4_quant_entry.cu
- sgl-kernel/csrc/gemm/nvfp4_quant_kernels.cu
- sgl-kernel/csrc/gemm/nvfp4_scaled_mm_entry.cu
- sgl-kernel/csrc/gemm/nvfp4_scaled_mm_kernels.cu
- sgl-kernel/csrc/torch_extension.cc
- sgl-kernel/include/sgl_kernel_ops.h
- sgl-kernel/python/sgl_kernel/__init__.py
- sgl-kernel/python/sgl_kernel/gemm.py
- sgl-kernel/setup.py
- sgl-kernel/tests/test_fp4_gemm.py
- sgl-kernel/tests/test_fp4_quantize.py
head_ref_oid: e718e691577f93a9b4fc8c1719a58e4b7ae0af10
artifact_dir: evidence/pull-bundles/sglang/gh-3899
---
# Support FP4 gemm (1/2)

- Repository: `sgl-project/sglang`
- PR: [3899](https://github.com/sgl-project/sglang/pull/3899)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `sgl-kernel/csrc/gemm/nvfp4_quant_entry.cu`
- `sgl-kernel/csrc/gemm/nvfp4_quant_kernels.cu`
- `sgl-kernel/csrc/gemm/nvfp4_scaled_mm_entry.cu`
- `sgl-kernel/csrc/gemm/nvfp4_scaled_mm_kernels.cu`
- `sgl-kernel/csrc/torch_extension.cc`
- `sgl-kernel/include/sgl_kernel_ops.h`
- `sgl-kernel/python/sgl_kernel/__init__.py`
- `sgl-kernel/python/sgl_kernel/gemm.py`
- `sgl-kernel/setup.py`
- `sgl-kernel/tests/test_fp4_gemm.py`
- `sgl-kernel/tests/test_fp4_quantize.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-3899`
