---
id: pr-pytorch-136885
repo: pytorch/pytorch
pr: 136885
title: '[cuDNN][SDPA] cherrypick Support `attn_bias` in cuDNN (#130482)'
author: eqy
date: '2024-09-30'
url: https://github.com/pytorch/pytorch/pull/136885
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 550ed97a8960abbe3c8e375be5db9490acf7b1a4
inclusion_reason: defer
changed_paths:
- aten/src/ATen/native/cudnn/MHA.cpp
- aten/src/ATen/native/cudnn/MHA.h
- aten/src/ATen/native/transformers/attention.cpp
- aten/src/ATen/native/transformers/cuda/attention.cu
- aten/src/ATen/native/transformers/cuda/attention_backward.cu
- aten/src/ATen/native/transformers/cuda/sdp_utils.cpp
- aten/src/ATen/native/transformers/sdp_utils_cpp.h
- test/test_transformers.py
artifact_dir: evidence/pull-bundles/pytorch/gh-136885
head_ref_oid: 0acd85640f49827daf605b0009161c533066a2ad
---
# [cuDNN][SDPA] cherrypick Support `attn_bias` in cuDNN (#130482)

- Repository: `pytorch/pytorch`
- PR: [136885](https://github.com/pytorch/pytorch/pull/136885)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `aten/src/ATen/native/cudnn/MHA.cpp`
- `aten/src/ATen/native/cudnn/MHA.h`
- `aten/src/ATen/native/transformers/attention.cpp`
- `aten/src/ATen/native/transformers/cuda/attention.cu`
- `aten/src/ATen/native/transformers/cuda/attention_backward.cu`
- `aten/src/ATen/native/transformers/cuda/sdp_utils.cpp`
- `aten/src/ATen/native/transformers/sdp_utils_cpp.h`
- `test/test_transformers.py`

## Evidence Bundle

`evidence/pull-bundles/pytorch/gh-136885`
