"vscode:/vscode.git/clone" did not exist on "f4e6a6c7900f4167ca6ea6fa6e34fdb2f0e59258"
Commit 42f54d88 authored by Tri Dao's avatar Tri Dao
Browse files

Edit mention of Triton implementation

Phil Tillet suggests calling it "experimental".
parent 4577151f
......@@ -10,7 +10,7 @@ IEEE Spectrum [article](https://spectrum.ieee.org/mlperf-rankings-2022) about ou
#### Triton implementation of FlashAttention
Phil Tillet (OpenAI) has an implementation of FlashAttention in Triton:
Phil Tillet (OpenAI) has an experimental implementation of FlashAttention in Triton:
https://github.com/openai/triton/blob/master/python/tutorials/06-fused-attention.py
As Triton is a higher-level language than CUDA, it might be easier to understand
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment