transformer_engine/jax/cpp_extensions/attention.py · 350a4ff1946e2b9562fc5850b3a8ca72ae799916 · OpenDAS / TransformerEngine

"tests/pytorch/test_fp8.py" did not exist on "782101277c90fa3ae800bb31b6465a318f0d954c"

[JAX] Support non-deterministic algo for cuDNN FA (#1056) · 86f27e12

Reese Wang authored Aug 08, 2024



* Support non-deterministic algo
Signed-off-by: Reese Wang <rewang@nvidia.com>

* Refine the helper function name
Signed-off-by: Reese Wang <rewang@nvidia.com>

* Move fixture to conftest.py
Signed-off-by: Reese Wang <rewang@nvidia.com>

---------
Signed-off-by: Reese Wang <rewang@nvidia.com>
Co-authored-by: Phuong Nguyen <36155692+phu0ngng@users.noreply.github.com>

86f27e12

attention.py 43.7 KB

Replace attention.py