---
id: pr-sglang-7392
repo: sgl-project/sglang
pr: 7392
title: '[AMD][Quantization] Add `int4fp8_moe` online quantization on ROCm'
author: fxmarty-amd
date: '2026-01-14'
url: https://github.com/sgl-project/sglang/pull/7392
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- moe
- quantization
techniques: []
hardware_features:
- fp8
kernel_types:
- moe
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 5af84c8af554fa0e6fb55890b39b97f155275372
inclusion_reason: kernel file changes
changed_paths:
- docs/advanced_features/quantization.md
- python/sglang/srt/configs/model_config.py
- python/sglang/srt/layers/int4fp8_utils.py
- python/sglang/srt/layers/linear.py
- python/sglang/srt/layers/quantization/__init__.py
- python/sglang/srt/layers/quantization/quark_int4fp8_moe.py
- python/sglang/srt/model_loader/utils.py
- python/sglang/srt/model_loader/weight_utils.py
- python/sglang/srt/server_args.py
- python/sglang/srt/utils/common.py
- test/srt/run_suite.py
- test/srt/test_int4fp8_moe.py
head_ref_oid: f751cffc4841edd31e662c43357d35b2fe102f95
artifact_dir: evidence/pull-bundles/sglang/gh-7392
---
# [AMD][Quantization] Add `int4fp8_moe` online quantization on ROCm

- Repository: `sgl-project/sglang`
- PR: [7392](https://github.com/sgl-project/sglang/pull/7392)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `docs/advanced_features/quantization.md`
- `python/sglang/srt/configs/model_config.py`
- `python/sglang/srt/layers/int4fp8_utils.py`
- `python/sglang/srt/layers/linear.py`
- `python/sglang/srt/layers/quantization/__init__.py`
- `python/sglang/srt/layers/quantization/quark_int4fp8_moe.py`
- `python/sglang/srt/model_loader/utils.py`
- `python/sglang/srt/model_loader/weight_utils.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/srt/utils/common.py`
- `test/srt/run_suite.py`
- `test/srt/test_int4fp8_moe.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-7392`
