---
id: pr-vllm-30885
repo: vllm-project/vllm
pr: 30885
title: '[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding'
author: LopezCastroRoberto
date: '2026-01-13'
url: https://github.com/vllm-project/vllm/pull/30885
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- nvfp4
- pipeline-stages
- quantization
techniques:
- pipeline-stages
hardware_features:
- fp4
- nvfp4
kernel_types:
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 8ef50d9a6b91b7800e69a846219069a29a0298a4
inclusion_reason: kernel file changes
changed_paths:
- .buildkite/test-pipeline.yaml
- tests/kernels/quantization/nvfp4_utils.py
- tests/kernels/quantization/test_flashinfer_nvfp4_scaled_mm.py
- tests/models/quantization/test_nvfp4.py
- vllm/_custom_ops.py
- vllm/envs.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/utils/flashinfer.py
head_ref_oid: 36e70cd6d343f4f6313e6b790d9fb5d5838ec5c5
artifact_dir: evidence/pull-bundles/vllm/gh-30885
---
# [Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding

- Repository: `vllm-project/vllm`
- PR: [30885](https://github.com/vllm-project/vllm/pull/30885)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `.buildkite/test-pipeline.yaml`
- `tests/kernels/quantization/nvfp4_utils.py`
- `tests/kernels/quantization/test_flashinfer_nvfp4_scaled_mm.py`
- `tests/models/quantization/test_nvfp4.py`
- `vllm/_custom_ops.py`
- `vllm/envs.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/utils/flashinfer.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-30885`
