---
id: pr-vllm-38670
repo: vllm-project/vllm
pr: 38670
title: '[Bugfix] Fix AWQ models batch invariance issues'
author: YM2132
date: '2026-04-03'
url: https://github.com/vllm-project/vllm/pull/38670
source_category: upstream-code
architectures:
- sm100
tags:
- Marlin
- benchmark_test
- gemm_quant
techniques:
- fine-grained-quantization
hardware_features: []
kernel_types:
- gemm
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 46f02e00f2d99944ecd24000bcc8be2a9504eafe
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tests/v1/determinism/test_batch_invariance.py
- vllm/model_executor/layers/batch_invariant.py
- vllm/model_executor/layers/quantization/awq.py
- vllm/model_executor/layers/quantization/awq_marlin.py
artifact_dir: evidence/pull-bundles/vllm/gh-38670
head_ref_oid: 75d751c9e3520e2aebbfc935f9c3c076862a41d3
---
# [Bugfix] Fix AWQ models batch invariance issues

- Repository: `vllm-project/vllm`
- PR: [38670](https://github.com/vllm-project/vllm/pull/38670)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tests/v1/determinism/test_batch_invariance.py`
- `vllm/model_executor/layers/batch_invariant.py`
- `vllm/model_executor/layers/quantization/awq.py`
- `vllm/model_executor/layers/quantization/awq_marlin.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-38670`
