tests/pytorch/test_fused_attn.py · aaba1b01a5f48ebf2c517065124afa7be6c82a23 · OpenDAS / TransformerEngine

"llama/ggml.h" did not exist on "0ce8bcfdaa4ddb58ba1c46c4e9fed1faec315bd6"

wgrad-accumulation patch for legacy megatron-LM (#451) · aaba1b01

Kirthi Shankar Sivamani authored Sep 30, 2023



* wgrad-accumulation patch for legacy megatron-LM
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* fix
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Fix
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Fix fused attention tests
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

---------
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

aaba1b01

test_fused_attn.py 33.1 KB

Replace test_fused_attn.py