---
id: pr-tilelang-1660
repo: tile-ai/tilelang
pr: 1660
title: '[Example] Add KDA algorithm implementation in tilelang'
author: wfloveiu
date: '2026-01-26'
url: https://github.com/tile-ai/tilelang/pull/1660
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- attention kernel
- fused-op
- triton kernel
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- attention
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 5748841bda1dc5b448d13508957bb70e4fd04ab5
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- .pre-commit-config.yaml
- examples/kda/FLA_KDA/cumsum.py
- examples/kda/FLA_KDA/fla_chunk_delta.py
- examples/kda/FLA_KDA/fla_chunk_inter.py
- examples/kda/FLA_KDA/fla_chunk_intra.py
- examples/kda/FLA_KDA/fla_chunk_intra_token_parallel.py
- examples/kda/FLA_KDA/fla_chunk_o.py
- examples/kda/FLA_KDA/fla_utils.py
- examples/kda/FLA_KDA/fla_wy_fast.py
- examples/kda/README.md
- examples/kda/chunk_bwd_dqkwg.py
- examples/kda/chunk_bwd_dv.py
- examples/kda/chunk_bwd_gla_dA.py
- examples/kda/chunk_bwd_intra.py
- examples/kda/chunk_delta_bwd.py
- examples/kda/chunk_delta_h_fwd.py
- examples/kda/chunk_inter_solve_fused.py
- examples/kda/chunk_intra_token_parallel.py
- examples/kda/chunk_o.py
- examples/kda/test_utils_kda.py
- examples/kda/wy_fast.py
- examples/kda/wy_fast_bwd.py
- src/op/atomic_add.h
artifact_dir: evidence/pull-bundles/tilelang/gh-1660
head_ref_oid: f87d431b14a841c812894e2cb2383852354e1326
---
# [Example] Add KDA algorithm implementation in tilelang

- Repository: `tile-ai/tilelang`
- PR: [1660](https://github.com/tile-ai/tilelang/pull/1660)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `.pre-commit-config.yaml`
- `examples/kda/FLA_KDA/cumsum.py`
- `examples/kda/FLA_KDA/fla_chunk_delta.py`
- `examples/kda/FLA_KDA/fla_chunk_inter.py`
- `examples/kda/FLA_KDA/fla_chunk_intra.py`
- `examples/kda/FLA_KDA/fla_chunk_intra_token_parallel.py`
- `examples/kda/FLA_KDA/fla_chunk_o.py`
- `examples/kda/FLA_KDA/fla_utils.py`
- `examples/kda/FLA_KDA/fla_wy_fast.py`
- `examples/kda/README.md`
- `examples/kda/chunk_bwd_dqkwg.py`
- `examples/kda/chunk_bwd_dv.py`
- `examples/kda/chunk_bwd_gla_dA.py`
- `examples/kda/chunk_bwd_intra.py`
- `examples/kda/chunk_delta_bwd.py`
- `examples/kda/chunk_delta_h_fwd.py`
- `examples/kda/chunk_inter_solve_fused.py`
- `examples/kda/chunk_intra_token_parallel.py`
- `examples/kda/chunk_o.py`
- `examples/kda/test_utils_kda.py`
- `examples/kda/wy_fast.py`
- `examples/kda/wy_fast_bwd.py`
- `src/op/atomic_add.h`

## Evidence Bundle

`evidence/pull-bundles/tilelang/gh-1660`
