---
id: pr-pytorch-170486
repo: pytorch/pytorch
pr: 170486
title: '[flex_attention] adds support for low precision K/V inputs in compiled mode with GPU'
author: howardzhang-cv
date: '2026-01-05'
url: https://github.com/pytorch/pytorch/pull/170486
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- flash-attention
techniques: []
hardware_features: []
kernel_types:
- attention
- flash-attention
languages:
- python
captured_at: '2026-04-17'
status: merged
merge_sha: 5d2e2f1c52b65a98dd9f3a9b5537b314f5fb0637
inclusion_reason: kernel file changes
changed_paths:
- test/inductor/test_flex_attention.py
- test/inductor/test_flex_decoding.py
- test/inductor/test_flex_flash.py
- torch/_higher_order_ops/flex_attention.py
- torch/_inductor/kernel/flex/flex_attention.py
- torch/_inductor/kernel/flex/flex_cpu.py
- torch/_inductor/kernel/flex/flex_flash_attention.py
- torch/_inductor/kernel/flex/templates/common.py.jinja
- torch/nn/attention/_utils.py
- torch/nn/attention/flex_attention.py
head_ref_oid: 461197e9c7166d63fa03f378875abd4305036d08
artifact_dir: evidence/pull-bundles/pytorch/gh-170486
---
# [flex_attention] adds support for low precision K/V inputs in compiled mode with GPU

- Repository: `pytorch/pytorch`
- PR: [170486](https://github.com/pytorch/pytorch/pull/170486)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `test/inductor/test_flex_attention.py`
- `test/inductor/test_flex_decoding.py`
- `test/inductor/test_flex_flash.py`
- `torch/_higher_order_ops/flex_attention.py`
- `torch/_inductor/kernel/flex/flex_attention.py`
- `torch/_inductor/kernel/flex/flex_cpu.py`
- `torch/_inductor/kernel/flex/flex_flash_attention.py`
- `torch/_inductor/kernel/flex/templates/common.py.jinja`
- `torch/nn/attention/_utils.py`
- `torch/nn/attention/flex_attention.py`

## Evidence Bundle

`evidence/pull-bundles/pytorch/gh-170486`
