---
id: pr-vllm-17331
repo: vllm-project/vllm
pr: 17331
title: '[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger'
author: rasmith
date: '2025-06-11'
url: https://github.com/vllm-project/vllm/pull/17331
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: c7ea0b56cd9a5e607f30cc637b4c800ce47bafca
inclusion_reason: defer
changed_paths:
- vllm/attention/backends/rocm_flash_attn.py
- vllm/config.py
- vllm/engine/arg_utils.py
artifact_dir: evidence/pull-bundles/vllm/gh-17331
head_ref_oid: 85ccf7c69a8a639506868a22aa949b00ddaa7cd0
---
# [AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger

- Repository: `vllm-project/vllm`
- PR: [17331](https://github.com/vllm-project/vllm/pull/17331)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `vllm/attention/backends/rocm_flash_attn.py`
- `vllm/config.py`
- `vllm/engine/arg_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-17331`
