tests/cpp/operator/test_rmsnorm.cu · 02a3582cff55aa06879730b8d02a49b3ceaac1b2 · OpenDAS / TransformerEngine

"vscode:/vscode.git/clone" did not exist on "112627e8b26ccbbee19d894c2c4c4d953970a6fd"

Move calculation of scale inverse to framework (#51) · 02a3582c

Kirthi Shankar Sivamani authored Jan 17, 2023



* Move scale inverse calculation to framework
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* cleanup
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Fix RMSNorm
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Fix tests
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Fix gated kernel/geglu
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

02a3582c

test_rmsnorm.cu 9 KB

Replace test_rmsnorm.cu