---
id: pr-vllm-34556
repo: vllm-project/vllm
pr: 34556
title: '[Quantization] add humming quantization kernel'
author: jinzhen-lin
date: '2026-04-24'
url: https://github.com/vllm-project/vllm/pull/34556
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- gemm_quant
- quantization kernel
- sm90
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- fp4
- fp8
- hopper
- mxfp4
- nvfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 9f771b3ab92d26a7d91a8255572c5d8d2b3ad601
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- vllm/config/model.py
- vllm/envs.py
- vllm/model_executor/layers/fused_moe/fused_humming_moe.py
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/layers/fused_moe/moe_fused_mul_sum.py
- vllm/model_executor/layers/linear.py
- vllm/model_executor/layers/quantization/__init__.py
- vllm/model_executor/layers/quantization/humming.py
- vllm/model_executor/layers/quantization/utils/humming_moe_utils.py
- vllm/model_executor/parameter.py
artifact_dir: evidence/pull-bundles/vllm/gh-34556
head_ref_oid: 4d7f19245c2f4201484101f2bac06e5b3905aeb6
---
# [Quantization] add humming quantization kernel

- Repository: `vllm-project/vllm`
- PR: [34556](https://github.com/vllm-project/vllm/pull/34556)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `vllm/config/model.py`
- `vllm/envs.py`
- `vllm/model_executor/layers/fused_moe/fused_humming_moe.py`
- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/layers/fused_moe/moe_fused_mul_sum.py`
- `vllm/model_executor/layers/linear.py`
- `vllm/model_executor/layers/quantization/__init__.py`
- `vllm/model_executor/layers/quantization/humming.py`
- `vllm/model_executor/layers/quantization/utils/humming_moe_utils.py`
- `vllm/model_executor/parameter.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-34556`
