Skip to content

GitLab

"StyleText/vscode:/vscode.git/clone" did not exist on "6a42745f96c7c75f845ef349ed5f07d666727a83"
Commit 42f54d88 authored by Tri Dao's avatar Tri Dao
Browse files

Edit mention of Triton implementation 

Phil Tillet suggests calling it "experimental".
parent 4577151f
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 42f54d88
...@@ -10,7 +10,7 @@ IEEE Spectrum [article](https://spectrum.ieee.org/mlperf-rankings-2022) about ou ...@@ -10,7 +10,7 @@ IEEE Spectrum [article](https://spectrum.ieee.org/mlperf-rankings-2022) about ou
#### Triton implementation of FlashAttention #### Triton implementation of FlashAttention
Phil Tillet (OpenAI) has an implementation of FlashAttention in Triton: Phil Tillet (OpenAI) has an experimental implementation of FlashAttention in Triton:
https://github.com/openai/triton/blob/master/python/tutorials/06-fused-attention.py https://github.com/openai/triton/blob/master/python/tutorials/06-fused-attention.py
As Triton is a higher-level language than CUDA, it might be easier to understand As Triton is a higher-level language than CUDA, it might be easier to understand
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment