---
id: pr-vllm-27814
repo: vllm-project/vllm
pr: 27814
title: '[Refactor] Make FP8 Linear Ops use kernel abstraction'
author: vllmellm
date: '2026-01-20'
url: https://github.com/vllm-project/vllm/pull/27814
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 148117ea2e689cd43df4be6892671a17cdae5833
inclusion_reason: defer
changed_paths:
- .buildkite/lm-eval-harness/configs/models-small-rocm.txt
- tests/compile/distributed/test_fusion_all_reduce.py
- tests/compile/distributed/test_sequence_parallelism.py
- tests/compile/test_functionalization.py
- tests/compile/test_fusion.py
- tests/compile/test_fusion_attn.py
- tests/compile/test_silu_mul_quant_fusion.py
- tests/kernels/quantization/test_scaled_mm_kernel_selection.py
- tests/quantization/test_compressed_tensors.py
- tests/utils.py
- vllm/_aiter_ops.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_fp8.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_int8.py
- vllm/model_executor/layers/quantization/fbgemm_fp8.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/ScaledMMLinearKernel.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/__init__.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/aiter.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/cpu.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/cutlass.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/flashinfer.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/pytorch.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/rocm.py
- vllm/model_executor/layers/quantization/kernels/scaled_mm/triton.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/model_executor/layers/quantization/ptpc_fp8.py
- vllm/model_executor/layers/quantization/quark/schemes/quark_w8a8_fp8.py
- vllm/model_executor/layers/quantization/quark/schemes/quark_w8a8_int8.py
- vllm/model_executor/layers/quantization/utils/quant_utils.py
- vllm/model_executor/layers/quantization/utils/w8a8_utils.py
artifact_dir: evidence/pull-bundles/vllm/gh-27814
head_ref_oid: 8bf199f07cf0d6b29fc5d4b95b0dc9360a811204
---
# [Refactor] Make FP8 Linear Ops use kernel abstraction

- Repository: `vllm-project/vllm`
- PR: [27814](https://github.com/vllm-project/vllm/pull/27814)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `.buildkite/lm-eval-harness/configs/models-small-rocm.txt`
- `tests/compile/distributed/test_fusion_all_reduce.py`
- `tests/compile/distributed/test_sequence_parallelism.py`
- `tests/compile/test_functionalization.py`
- `tests/compile/test_fusion.py`
- `tests/compile/test_fusion_attn.py`
- `tests/compile/test_silu_mul_quant_fusion.py`
- `tests/kernels/quantization/test_scaled_mm_kernel_selection.py`
- `tests/quantization/test_compressed_tensors.py`
- `tests/utils.py`
- `vllm/_aiter_ops.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_fp8.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_int8.py`
- `vllm/model_executor/layers/quantization/fbgemm_fp8.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/ScaledMMLinearKernel.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/__init__.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/aiter.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/cpu.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/cutlass.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/flashinfer.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/pytorch.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/rocm.py`
- `vllm/model_executor/layers/quantization/kernels/scaled_mm/triton.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/model_executor/layers/quantization/ptpc_fp8.py`
- `vllm/model_executor/layers/quantization/quark/schemes/quark_w8a8_fp8.py`
- `vllm/model_executor/layers/quantization/quark/schemes/quark_w8a8_int8.py`
- `vllm/model_executor/layers/quantization/utils/quant_utils.py`
- `vllm/model_executor/layers/quantization/utils/w8a8_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-27814`
