---
id: pr-flash-attention-cutlass-19
repo: dcutoolkit/deeplearing/flash-attention-cutlass
pr: 19
title: 添加 dim128 varlen fp8
author: wangchao
date: '2026-01-08'
url: http://42.228.13.241:10068/dcutoolkit/deeplearing/flash-attention-cutlass/-/merge_requests/19
source_category: upstream-code
architectures:
- dcu
- gfx928
- gfx936
- gfx938
tags:
- attention
- benchmark
- cutlass
- dcu
- flash-attention
- hip
- quantization
- rocm
- softmax
techniques:
- benchmarking
- build-system
- quantization
hardware_features:
- fp8
kernel_types:
- attention
- quantization
- softmax
languages:
- cpp
- cuda-cpp
- hip
- python
captured_at: '2026-05-19T07:28:38.621971+00:00'
status: open
merge_sha: unknown
inclusion_reason: Use as LightOp/DCU upstream MR evidence; web/API MR state was unavailable, so validate portability against local LightOp before reuse.
changed_paths:
- benchmarks/benchmark_fa_varlen_mla_test_fp8.py
- benchmarks/benchmark_fa_varlen_test_fp8.py
- csrc/flash_attn/flash_api.cpp
- csrc/flash_attn/src/dropout.h
- csrc/flash_attn/src/flash.h
- csrc/flash_attn/src/flash_bwd_kernel.h
- csrc/flash_attn/src/flash_bwd_launch_template.h
- csrc/flash_attn/src/flash_fwd_hdim128_fp8_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_hdim128_fp8_sm80.cu
- csrc/flash_attn/src/flash_fwd_hdim192_hdim128_fp8_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_hdim192_hdim128_fp8_sm80.cu
- csrc/flash_attn/src/flash_fwd_kernel.h
- csrc/flash_attn/src/flash_fwd_launch_template.h
- csrc/flash_attn/src/flash_fwd_sparse_kernel.h
- csrc/flash_attn/src/flash_fwd_split_hdim128_fp8_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_split_hdim128_fp8_sm80.cu
- csrc/flash_attn/src/flash_fwd_split_hdim64_fp8_causal_sm80.cu
- csrc/flash_attn/src/flash_fwd_split_hdim64_fp8_sm80.cu
- csrc/flash_attn/src/kernel_traits.h
- csrc/flash_attn/src/mask.h
- csrc/flash_attn/src/paged_attention.cu
- csrc/flash_attn/src/softmax.h
- csrc/flash_attn/src/static_switch.h
- csrc/flash_attn/src/utils.h
- flash_attn/__init__.py
- flash_attn/flash_attn_interface.py
- setup.py
- tests/test_flash_attn.py
- tests/test_flash_attn_saux.py
- tests/test_flash_attn_varlen_fp8.py
- tests/test_pa.py
- tests/test_prefix_kvcache.py
- tests/test_prefix_kvcache_fp8.py
artifact_dir: evidence/pull-bundles/flash-attention-cutlass/mr-19
---
# 添加 dim128 varlen fp8

- Repository: `dcutoolkit/deeplearing/flash-attention-cutlass`
- MR: [19](http://42.228.13.241:10068/dcutoolkit/deeplearing/flash-attention-cutlass/-/merge_requests/19)
- Decision: `include`
- Reason: Use as LightOp/DCU upstream MR evidence; web/API MR state was unavailable, so validate portability against local LightOp before reuse.

## Changed Paths

- `benchmarks/benchmark_fa_varlen_mla_test_fp8.py`
- `benchmarks/benchmark_fa_varlen_test_fp8.py`
- `csrc/flash_attn/flash_api.cpp`
- `csrc/flash_attn/src/dropout.h`
- `csrc/flash_attn/src/flash.h`
- `csrc/flash_attn/src/flash_bwd_kernel.h`
- `csrc/flash_attn/src/flash_bwd_launch_template.h`
- `csrc/flash_attn/src/flash_fwd_hdim128_fp8_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_hdim128_fp8_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_hdim192_hdim128_fp8_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_hdim192_hdim128_fp8_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_kernel.h`
- `csrc/flash_attn/src/flash_fwd_launch_template.h`
- `csrc/flash_attn/src/flash_fwd_sparse_kernel.h`
- `csrc/flash_attn/src/flash_fwd_split_hdim128_fp8_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_split_hdim128_fp8_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_split_hdim64_fp8_causal_sm80.cu`
- `csrc/flash_attn/src/flash_fwd_split_hdim64_fp8_sm80.cu`
- `csrc/flash_attn/src/kernel_traits.h`
- `csrc/flash_attn/src/mask.h`
- `csrc/flash_attn/src/paged_attention.cu`
- `csrc/flash_attn/src/softmax.h`
- `csrc/flash_attn/src/static_switch.h`
- `csrc/flash_attn/src/utils.h`
- `flash_attn/__init__.py`
- `flash_attn/flash_attn_interface.py`
- `setup.py`
- `tests/test_flash_attn.py`
- `tests/test_flash_attn_saux.py`
- `tests/test_flash_attn_varlen_fp8.py`
- `tests/test_pa.py`
- `tests/test_prefix_kvcache.py`
- `tests/test_prefix_kvcache_fp8.py`

## Artifact Bundle

`evidence/pull-bundles/flash-attention-cutlass/mr-19`
