API_Reference_Guide.rst 1.35 KB
Newer Older
randyh62's avatar
randyh62 committed
1
2
3
.. meta::
  :description: Composable Kernel documentation and API reference library
  :keywords: composable kernel, CK, ROCm, API, documentation
pmaybank's avatar
pmaybank committed
4

randyh62's avatar
randyh62 committed
5
6
7
8
9
.. _api-reference:

********************************************************************
API reference guide
********************************************************************
pmaybank's avatar
pmaybank committed
10
11


12
13
This document contains details of the APIs for the Composable Kernel (CK) library and introduces
some of the key design principles that are used to write new classes that extend CK functionality.
pmaybank's avatar
pmaybank committed
14
15
16
17
18
19
20

=================
Using CK API
=================

This section describes how to use the CK library API.

21
=================
pmaybank's avatar
pmaybank committed
22
CK Datatypes
23
24
25
26
=================

-----------------
DeviceMem
pmaybank's avatar
pmaybank committed
27
28
-----------------

29
30
31
32
33
34
.. doxygenstruct:: DeviceMem

---------------------------
Kernels For Flashattention
---------------------------

randyh62's avatar
randyh62 committed
35
The Flashattention algorithm is defined in :cite:t:`dao2022flashattention`. This section lists
36
the classes that are used in the CK GPU implementation of Flashattention.
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53

**Gridwise classes**

.. doxygenstruct:: ck::GridwiseBatchedGemmSoftmaxGemm_Xdl_CShuffle

**Blockwise classes**

.. doxygenstruct:: ck::ThreadGroupTensorSliceTransfer_v4r1

.. doxygenstruct:: ck::BlockwiseGemmXdlops_v2

.. doxygenstruct:: ck::BlockwiseSoftmax

**Threadwise classes**

.. doxygenstruct:: ck::ThreadwiseTensorSliceTransfer_StaticToStatic

Sam Wu's avatar
Sam Wu committed
54
.. bibliography::