---
id: pr-flashinfer-2904
repo: flashinfer-ai/flashinfer
pr: 2904
title: 'perf: Optimize CuTe-DSL fp4 and fp8 quantization kernels'
author: bkryu
date: '2026-04-01'
url: https://github.com/flashinfer-ai/flashinfer/pull/2904
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- fp8
- nvfp4
- quantization
techniques: []
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- quantization
languages:
- cute-dsl
captured_at: '2026-04-27'
status: merged
merge_sha: d476c61c3f8bcbbca30755b330a0c10b141dede3
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/bench_mxfp4_quantize_backend_comparison.py
- benchmarks/bench_mxfp8_quantize_backend_comparison.py
- benchmarks/bench_nvfp4_quantize_backend_comparison.py
- flashinfer/cute_dsl/fp4_common.py
- flashinfer/quantization/kernels/__init__.py
- flashinfer/quantization/kernels/mxfp4_quantize.py
- flashinfer/quantization/kernels/mxfp8_quantize.py
- flashinfer/quantization/kernels/nvfp4_quantize.py
- flashinfer/quantization/quantization_cute_dsl_utils.py
- tests/utils/test_fp4_quantize.py
- tests/utils/test_fp4_quantize_padding.py
- tests/utils/test_fp8_quantize.py
head_ref_oid: b213c4e62fa70eac1cf62b0d4b8bba63685e7178
artifact_dir: evidence/pull-bundles/flashinfer/gh-2904
---
# perf: Optimize CuTe-DSL fp4 and fp8 quantization kernels

- Repository: `flashinfer-ai/flashinfer`
- PR: [2904](https://github.com/flashinfer-ai/flashinfer/pull/2904)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/bench_mxfp4_quantize_backend_comparison.py`
- `benchmarks/bench_mxfp8_quantize_backend_comparison.py`
- `benchmarks/bench_nvfp4_quantize_backend_comparison.py`
- `flashinfer/cute_dsl/fp4_common.py`
- `flashinfer/quantization/kernels/__init__.py`
- `flashinfer/quantization/kernels/mxfp4_quantize.py`
- `flashinfer/quantization/kernels/mxfp8_quantize.py`
- `flashinfer/quantization/kernels/nvfp4_quantize.py`
- `flashinfer/quantization/quantization_cute_dsl_utils.py`
- `tests/utils/test_fp4_quantize.py`
- `tests/utils/test_fp4_quantize_padding.py`
- `tests/utils/test_fp8_quantize.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2904`
