---
id: pr-vllm-27883
repo: vllm-project/vllm
pr: 27883
title: '[Performance] Fused blockwise quant RMS norm'
author: ElizaWszola
date: '2025-12-07'
url: https://github.com/vllm-project/vllm/pull/27883
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- gemm
- kernel-fusion
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- gemm
- quantization
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: af0444bf40b7db2f3fb9fe1508d25ceba24cac87
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/fused_kernels/layernorm_rms_benchmarks.py
- csrc/dispatch_utils.h
- csrc/ops.h
- csrc/quantization/fused_kernels/fused_layernorm_dynamic_per_token_quant.cu
- csrc/quantization/fused_kernels/layernorm_utils.cuh
- csrc/torch_bindings.cpp
- tests/compile/test_fusion.py
- tests/kernels/core/test_fused_quant_layernorm.py
- vllm/_custom_ops.py
- vllm/compilation/fusion.py
- vllm/compilation/matcher_utils.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
- vllm/model_executor/layers/quantization/utils/quant_utils.py
- vllm/utils/deep_gemm.py
head_ref_oid: 990bc65dd8c5e201404689dc8d18c06d6ee0c8ee
artifact_dir: evidence/pull-bundles/vllm/gh-27883
---
# [Performance] Fused blockwise quant RMS norm

- Repository: `vllm-project/vllm`
- PR: [27883](https://github.com/vllm-project/vllm/pull/27883)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/fused_kernels/layernorm_rms_benchmarks.py`
- `csrc/dispatch_utils.h`
- `csrc/ops.h`
- `csrc/quantization/fused_kernels/fused_layernorm_dynamic_per_token_quant.cu`
- `csrc/quantization/fused_kernels/layernorm_utils.cuh`
- `csrc/torch_bindings.cpp`
- `tests/compile/test_fusion.py`
- `tests/kernels/core/test_fused_quant_layernorm.py`
- `vllm/_custom_ops.py`
- `vllm/compilation/fusion.py`
- `vllm/compilation/matcher_utils.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`
- `vllm/model_executor/layers/quantization/utils/quant_utils.py`
- `vllm/utils/deep_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-27883`
