---
id: pr-sglang-10312
repo: sgl-project/sglang
pr: 10312
title: Reland [1/2] Optimizations and refactors about quant kernel
author: fzyzcjy
date: '2025-10-11'
url: https://github.com/sgl-project/sglang/pull/10312
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 21337b22b960c8bca5410c73ba4f36bfca72443c
inclusion_reason: defer
changed_paths:
- python/sglang/srt/layers/quantization/fp8_kernel.py
- python/sglang/srt/layers/quantization/int8_kernel.py
- python/sglang/srt/utils/bench_utils.py
- sgl-kernel/CMakeLists.txt
- sgl-kernel/benchmark/bench_per_token_group_quant_8bit.py
- sgl-kernel/csrc/common_extension.cc
- sgl-kernel/csrc/gemm/per_token_group_quant_8bit.cu
- sgl-kernel/csrc/gemm/per_token_group_quant_8bit_v2.cu
- sgl-kernel/include/sgl_kernel_ops.h
- sgl-kernel/python/sgl_kernel/__init__.py
- sgl-kernel/python/sgl_kernel/gemm.py
- sgl-kernel/python/sgl_kernel/test_utils.py
- sgl-kernel/tests/test_per_token_group_quant_8bit.py
artifact_dir: evidence/pull-bundles/sglang/gh-10312
head_ref_oid: 07f6abf6c8c1e2a87c35b33e5273f4699dc6242c
---
# Reland [1/2] Optimizations and refactors about quant kernel

- Repository: `sgl-project/sglang`
- PR: [10312](https://github.com/sgl-project/sglang/pull/10312)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `python/sglang/srt/layers/quantization/fp8_kernel.py`
- `python/sglang/srt/layers/quantization/int8_kernel.py`
- `python/sglang/srt/utils/bench_utils.py`
- `sgl-kernel/CMakeLists.txt`
- `sgl-kernel/benchmark/bench_per_token_group_quant_8bit.py`
- `sgl-kernel/csrc/common_extension.cc`
- `sgl-kernel/csrc/gemm/per_token_group_quant_8bit.cu`
- `sgl-kernel/csrc/gemm/per_token_group_quant_8bit_v2.cu`
- `sgl-kernel/include/sgl_kernel_ops.h`
- `sgl-kernel/python/sgl_kernel/__init__.py`
- `sgl-kernel/python/sgl_kernel/gemm.py`
- `sgl-kernel/python/sgl_kernel/test_utils.py`
- `sgl-kernel/tests/test_per_token_group_quant_8bit.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-10312`
