---
id: pr-flash-attention-cutlass-15
repo: dcutoolkit/deeplearing/flash-attention-cutlass
pr: 15
title: feat:hdim16 mha_masked_fwd_bias 支持 fp32类型
author: liandm
date: '2025-11-04'
url: http://42.228.13.241:10068/dcutoolkit/deeplearing/flash-attention-cutlass/-/merge_requests/15
source_category: upstream-code
architectures:
- dcu
- gfx928
- gfx936
- gfx938
tags:
- attention
- cutlass
- dcu
- flash-attention
- hip
- rocm
techniques:
- build-system
hardware_features:
- bf16
- fp16
kernel_types:
- attention
languages:
- cmake
- cpp
- cuda-cpp
- hip
- markdown
- python
captured_at: '2026-05-19T07:28:38.621971+00:00'
status: open
merge_sha: unknown
inclusion_reason: Use as LightOp/DCU upstream MR evidence; web/API MR state was unavailable, so validate portability against local LightOp before reuse.
changed_paths:
- csrc/flash_attn/flash_api.cpp
- csrc/flash_attn/src/dropout.h
- csrc/flash_attn/src/flash.h
- csrc/flash_attn/src/flash_fwd_bias_hdim16_bf16_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim16_bf16_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim16_fp16_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim16_fp16_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim16_fp32_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim16_fp32_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim32_bf16_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim32_bf16_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim32_fp16_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_bias_hdim32_fp16_sm80.cu
- csrc/flash_attn/src/flash_fwd_kernel.h
- csrc/flash_attn/src/flash_fwd_launch_template.h
- csrc/flash_attn/src/kernel_traits.h
- csrc/flash_attn/src/mask.h
- csrc/flash_attn/src/utils.h
- csrc/flash_c_api/CMakeLists.txt
- csrc/flash_c_api/README.md
- csrc/flash_c_api/demo/README.md
- csrc/flash_c_api/demo/fa_with_bias_demo.cu
- csrc/flash_c_api/demo/fa_with_bias_demo.py
- csrc/flash_c_api/flash_c_api.cpp
- csrc/flash_c_api/flash_c_api.h
- csrc/flash_c_api/hip_convert.py
- csrc/flash_c_api/tensor_desc.h
- setup.py
artifact_dir: evidence/pull-bundles/flash-attention-cutlass/mr-15
---
# feat:hdim16 mha_masked_fwd_bias 支持 fp32类型

- Repository: `dcutoolkit/deeplearing/flash-attention-cutlass`
- MR: [15](http://42.228.13.241:10068/dcutoolkit/deeplearing/flash-attention-cutlass/-/merge_requests/15)
- Decision: `include`
- Reason: Use as LightOp/DCU upstream MR evidence; web/API MR state was unavailable, so validate portability against local LightOp before reuse.

## Changed Paths

- `csrc/flash_attn/flash_api.cpp`
- `csrc/flash_attn/src/dropout.h`
- `csrc/flash_attn/src/flash.h`
- `csrc/flash_attn/src/flash_fwd_bias_hdim16_bf16_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim16_bf16_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim16_fp16_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim16_fp16_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim16_fp32_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim16_fp32_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim32_bf16_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim32_bf16_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim32_fp16_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_bias_hdim32_fp16_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_kernel.h`
- `csrc/flash_attn/src/flash_fwd_launch_template.h`
- `csrc/flash_attn/src/kernel_traits.h`
- `csrc/flash_attn/src/mask.h`
- `csrc/flash_attn/src/utils.h`
- `csrc/flash_c_api/CMakeLists.txt`
- `csrc/flash_c_api/README.md`
- `csrc/flash_c_api/demo/README.md`
- `csrc/flash_c_api/demo/fa_with_bias_demo.cu`
- `csrc/flash_c_api/demo/fa_with_bias_demo.py`
- `csrc/flash_c_api/flash_c_api.cpp`
- `csrc/flash_c_api/flash_c_api.h`
- `csrc/flash_c_api/hip_convert.py`
- `csrc/flash_c_api/tensor_desc.h`
- `setup.py`

## Artifact Bundle

`evidence/pull-bundles/flash-attention-cutlass/mr-15`
