---
id: pr-thunderkittens-18
repo: HazyResearch/ThunderKittens
pr: 18
title: Cutlass parity
author: benjaminfspector
date: '2024-04-26'
url: https://github.com/HazyResearch/ThunderKittens/pull/18
source_category: upstream-code
architectures:
- sm100
tags:
- cutlass
techniques: []
hardware_features: []
kernel_types: []
languages:
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: c706a6af0df04bd07af7657c48cf3b09d296312b
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- README.md
- examples/attn_fwd/4090_ker.cu
- examples/attn_fwd_tma_wgmma/harness.impl
- examples/attn_fwd_tma_wgmma/tictoc_ker.cu
- examples/based/linear_attn_forward/lin_attn.cu
- examples/based/linear_attn_forward/linear_attend_causal_reg.cu
- examples/based/tc_attend/tc_attend.cu
- examples/hedgehog/hedgehog.cu
- examples/micros/micro.cu
- src/ops/group/memory/tile/shared_to_register.cuh
- src/ops/group/wgmma/base/4x1.impl
- src/ops/group/wgmma/base/4x16.impl
- src/ops/group/wgmma/base/4x2.impl
- src/ops/group/wgmma/base/4x3.impl
- src/ops/group/wgmma/base/4x4.impl
- src/ops/group/wgmma/base/4x6.impl
- src/ops/group/wgmma/base/4x8.impl
- src/ops/group/wgmma/base/base.cuh
- src/ops/group/wgmma/wgmma.cuh
- src/ops/warp/memory/tile/tma.cuh
- src/ops/warp/memory/util/tma.cuh
- src/ops/warp/memory/vec/tma.cuh
- src/types/shared/st.cuh
- src/types/shared/st_layout.cuh
- tests/group/memory/tile/global_to_shared.cu
- tests/group/memory/tile/shared_to_register.cu
- tests/group/shared/tile/conversions.cu
- tests/group/shared/tile/maps.cu
- tests/group/shared/tile/reductions.cu
- tests/group/wgmma/mma.cu
- tests/testing_commons/testing_commons.cu
- tests/testing_commons/testing_commons.cuh
- tests/warp/memory/tile/dsmem.cu
- tests/warp/memory/tile/global_to_shared.cu
- tests/warp/memory/tile/shared_to_register.cu
- tests/warp/memory/tile/tma.cu
- tests/warp/register/tile/mma.cu
- tests/warp/shared/tile/conversions.cu
- tests/warp/shared/tile/conversions.cuh
- tests/warp/shared/tile/maps.cu
- tests/warp/shared/tile/reductions.cu
artifact_dir: evidence/pull-bundles/thunderkittens/gh-18
head_ref_oid: 73ab2265ad3792d79c1c1d51f44775b4fa52bf2b
---
# Cutlass parity

- Repository: `HazyResearch/ThunderKittens`
- PR: [18](https://github.com/HazyResearch/ThunderKittens/pull/18)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `README.md`
- `examples/attn_fwd/4090_ker.cu`
- `examples/attn_fwd_tma_wgmma/harness.impl`
- `examples/attn_fwd_tma_wgmma/tictoc_ker.cu`
- `examples/based/linear_attn_forward/lin_attn.cu`
- `examples/based/linear_attn_forward/linear_attend_causal_reg.cu`
- `examples/based/tc_attend/tc_attend.cu`
- `examples/hedgehog/hedgehog.cu`
- `examples/micros/micro.cu`
- `src/ops/group/memory/tile/shared_to_register.cuh`
- `src/ops/group/wgmma/base/4x1.impl`
- `src/ops/group/wgmma/base/4x16.impl`
- `src/ops/group/wgmma/base/4x2.impl`
- `src/ops/group/wgmma/base/4x3.impl`
- `src/ops/group/wgmma/base/4x4.impl`
- `src/ops/group/wgmma/base/4x6.impl`
- `src/ops/group/wgmma/base/4x8.impl`
- `src/ops/group/wgmma/base/base.cuh`
- `src/ops/group/wgmma/wgmma.cuh`
- `src/ops/warp/memory/tile/tma.cuh`
- `src/ops/warp/memory/util/tma.cuh`
- `src/ops/warp/memory/vec/tma.cuh`
- `src/types/shared/st.cuh`
- `src/types/shared/st_layout.cuh`
- `tests/group/memory/tile/global_to_shared.cu`
- `tests/group/memory/tile/shared_to_register.cu`
- `tests/group/shared/tile/conversions.cu`
- `tests/group/shared/tile/maps.cu`
- `tests/group/shared/tile/reductions.cu`
- `tests/group/wgmma/mma.cu`
- `tests/testing_commons/testing_commons.cu`
- `tests/testing_commons/testing_commons.cuh`
- `tests/warp/memory/tile/dsmem.cu`
- `tests/warp/memory/tile/global_to_shared.cu`
- `tests/warp/memory/tile/shared_to_register.cu`
- `tests/warp/memory/tile/tma.cu`
- `tests/warp/register/tile/mma.cu`
- `tests/warp/shared/tile/conversions.cu`
- `tests/warp/shared/tile/conversions.cuh`
- `tests/warp/shared/tile/maps.cu`
- `tests/warp/shared/tile/reductions.cu`

## Evidence Bundle

`evidence/pull-bundles/thunderkittens/gh-18`
