transformer_engine/jax/csrc/modules.h · ff760a9d838ae4617600cccb22131d0359ce0296 · OpenDAS / TransformerEngine · GitLab

Find file Blame History Permalink

[JAX] Support layernorm/rmsnorm sm_margin control through environment variable (#520) · 753eed31
zlsh80826 authored Nov 30, 2023
```
Support layernorm sm_margin through environment variables
Signed-off-by: Reese Wang <rewang@nvidia.com>
```
753eed31

modules.h 6.69 KB