transformer_engine/pytorch/transformer.py · bcbd4be0f3e03e055bd591804f4d6eded7155a58 · OpenDAS / TransformerEngine

Fix FlashAttention tests (#99) · bcbd4be0

tcherckez-nvidia authored Mar 29, 2023


Signed-off-by: Tal Cherckez <tcherckez@nvidia.com>
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Co-authored-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

bcbd4be0

transformer.py 50 KB

Replace transformer.py