transformer_engine/paddle/cpp_extensions.py · 749a7f69a3e091632030580b6f49f7809c96db62 · OpenDAS / TransformerEngine

"git@developer.sourcefind.cn:kecinstone/2024-pra-vllm.git" did not exist on "5c976a7e1a1bec875bf6474824b7dff39e38de18"

[Paddle] Support flash attention (#330) · 749a7f69

Shijie authored Jul 20, 2023



* add flash attn tests
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

* update flash attn
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

* fix random seed
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

---------
Signed-off-by: Shijie Wang <jaywan@nvidia.com>
Co-authored-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

749a7f69

cpp_extensions.py 19.5 KB

Replace cpp_extensions.py