Commits · 8bed1d63b881ae0e117ca12f188fabb8abbfc54b · OpenDAS / Megatron-LM

22 Dec, 2020 1 commit
- Add residual connection in fp32 machinery · 8bed1d63
  mohammad authored Dec 21, 2020
  
  8bed1d63
19 Dec, 2020 1 commit
- Rename --batch-size to --micro-batch-size and drop in-minibatch from... · 9019bbf4
  mohammad authored Dec 06, 2020
```
Rename --batch-size to --micro-batch-size and drop in-minibatch from --num-micro-batches-in-minibatch
```
  9019bbf4
13 Oct, 2020 1 commit
- suppress kernel loading output · 8fca9b49
  Vijay Korthikanti authored Oct 12, 2020
  
  8fca9b49
08 Oct, 2020 1 commit
- Create build directory for fused_kernels before building. · 54ded172
  Jared Casper authored Oct 07, 2020
  
  54ded172
06 Oct, 2020 1 commit
- build directory · 3dcd7dc0
  Vijay Korthikanti authored Oct 05, 2020
  
  3dcd7dc0
05 Oct, 2020 2 commits
- build_directory argument · a7f4e460
  Vijay Korthikanti authored Oct 05, 2020
  
  a7f4e460
- avoid non deterministic arch order in compilation · 37d77ca0
  Vijay Korthikanti authored Oct 05, 2020
  
  37d77ca0
18 Sep, 2020 1 commit
- scaling-generalized masking-softmax fusion kernel · d73def35
  root authored Sep 18, 2020
  
  d73def35
11 Sep, 2020 1 commit
- Various speed optimizations. · 51a2e6b0
  Vijay Korthikanti authored Sep 11, 2020
  
  51a2e6b0