Skip to content

GitLab

Unverified Commit d478eeec authored by Tri Dao's avatar Tri Dao Committed by GitHub
Browse files

Merge pull request #154 from kuizhiqing/usage 

add paddlepaddle in usage
parents d6fc8605 c5be8d3a
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
usage.md
View file @ d478eeec
...@@ -27,6 +27,8 @@ PR or email us. We'd very much like to hear from you! ...@@ -27,6 +27,8 @@ PR or email us. We'd very much like to hear from you!
- EleutherAI's [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/pull/725). This is a research library for training large language transformer models at scale based on NVIDIA's Megatron-LM and Microsoft's DeepSpeed. - EleutherAI's [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/pull/725). This is a research library for training large language transformer models at scale based on NVIDIA's Megatron-LM and Microsoft's DeepSpeed.
- PaddlePaddle: integrated into the framework with [API](https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/nn/functional/flash_attention.py) `paddle.nn.functional.flash_attention`.
## MLPerf benchmarks ## MLPerf benchmarks
[MLPerf](https://mlcommons.org/en/) is a competitive machine learning performance benchmark. FlashAttention [MLPerf](https://mlcommons.org/en/) is a competitive machine learning performance benchmark. FlashAttention
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment