---
id: pr-vllm-24666
repo: vllm-project/vllm
pr: 24666
title: '[Performance] Move apply_w8a8_block_fp8_linear to an op class'
author: ElizaWszola
date: '2025-09-23'
url: https://github.com/vllm-project/vllm/pull/24666
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- fp8
- gemm
- quantization
techniques: []
hardware_features:
- fp8
kernel_types:
- gemm
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 63400259d05485330fb23635af892b3fce160dea
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/cutlass_benchmarks/w8a8_benchmarks.py
- benchmarks/kernels/deepgemm/benchmark_fp8_block_dense_gemm.py
- tests/kernels/quantization/test_block_fp8.py
- tests/kernels/quantization/test_fp8_quant_group.py
- tests/model_executor/test_enabled_custom_ops.py
- tests/quantization/test_compressed_tensors.py
- vllm/config/__init__.py
- vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_fp8.py
- vllm/model_executor/layers/quantization/deepgemm.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/input_quant_fp8.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
- vllm/utils/deep_gemm.py
head_ref_oid: 00bd638a27858042538745ccf01927c3befb62d3
artifact_dir: evidence/pull-bundles/vllm/gh-24666
---
# [Performance] Move apply_w8a8_block_fp8_linear to an op class

- Repository: `vllm-project/vllm`
- PR: [24666](https://github.com/vllm-project/vllm/pull/24666)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/cutlass_benchmarks/w8a8_benchmarks.py`
- `benchmarks/kernels/deepgemm/benchmark_fp8_block_dense_gemm.py`
- `tests/kernels/quantization/test_block_fp8.py`
- `tests/kernels/quantization/test_fp8_quant_group.py`
- `tests/model_executor/test_enabled_custom_ops.py`
- `tests/quantization/test_compressed_tensors.py`
- `vllm/config/__init__.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_fp8.py`
- `vllm/model_executor/layers/quantization/deepgemm.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/input_quant_fp8.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`
- `vllm/utils/deep_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-24666`
