---
id: pr-sglang-3056
repo: sgl-project/sglang
pr: 3056
title: 'feat: integrate bmm_fp8 kernel into sgl-kernel'
author: zhyncs
date: '2025-01-22'
url: https://github.com/sgl-project/sglang/pull/3056
source_category: upstream-code
architectures:
- sm90
- sm100
tags:
- fp8
- gemm
- moe
techniques:
- fine-grained-quantization
hardware_features:
- fp8
- wgmma
kernel_types:
- gemm
- mla
- moe
languages:
- cuda-cpp
- python
captured_at: 2026-04-16
status: merged
merge_sha: bf669606eb84e12dc1ecf15b23c1eedab204d660
inclusion_reason: manually curated, Blackwell kernel relevance
changed_paths:
- sgl-kernel/setup.py
- sgl-kernel/src/sgl-kernel/__init__.py
- sgl-kernel/src/sgl-kernel/csrc/sgl_kernel_ops.cu
- sgl-kernel/src/sgl-kernel/ops/__init__.py
- sgl-kernel/src/sgl-kernel/ops/utils.py
- sgl-kernel/tests/test_bmm_fp8.py
head_ref_oid: ae7d014508ab4674d152f6c875c3d18290021394
artifact_dir: evidence/pull-bundles/sglang/gh-3056
---
# feat: integrate bmm_fp8 kernel into sgl-kernel

- Repository: `sgl-project/sglang`
- PR: [3056](https://github.com/sgl-project/sglang/pull/3056)
- Decision: `manually curated, Blackwell kernel relevance`
- Reason: manually curated, Blackwell kernel relevance

## Changed Paths

- `sgl-kernel/setup.py`
- `sgl-kernel/src/sgl-kernel/__init__.py`
- `sgl-kernel/src/sgl-kernel/csrc/sgl_kernel_ops.cu`
- `sgl-kernel/src/sgl-kernel/ops/__init__.py`
- `sgl-kernel/src/sgl-kernel/ops/utils.py`
- `sgl-kernel/tests/test_bmm_fp8.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-3056`
