Commits · 49c9895b675dad5702200f46f77cf43eca74175e · OpenDAS / Uni-Core

11 Aug, 2022 3 commits
- fix bug in return future mask · 49c9895b
  Guolin Ke authored Aug 11, 2022
  
  49c9895b
- fix a bug for return attn_weights · 689e0b24
  Guolin Ke authored Aug 11, 2022
  
  689e0b24
- fix bug in flatten parameters · a92c6297
  Guolin Ke authored Aug 11, 2022
  
  a92c6297
04 Aug, 2022 1 commit
- support softmax for large columns (#6) · 6c18b2ed
  Guolin Ke authored Aug 04, 2022
```
* support softmax for large columns

* more tests
```
  6c18b2ed
30 Jul, 2022 1 commit
- support gradient checkpointing · 31fe887e
  Guolin Ke authored Jul 30, 2022
  
  31fe887e
28 Jul, 2022 1 commit
- flatten parameters (#4) · 89ac1b7b
  Guolin Ke authored Jul 28, 2022
```
flatten memories
```
  89ac1b7b
27 Jul, 2022 1 commit
- fix softmax cpu · 1e8b6e33
  Guolin Ke authored Jul 27, 2022
  
  1e8b6e33
24 Jul, 2022 2 commits
- warning about missing keys in loading model · 21cb6b39
  Guolin Ke authored Jul 24, 2022
  
  21cb6b39
- support softmax with bias and mask (#2) · 8da5eaaf
  Guolin Ke authored Jul 24, 2022
```
* try

* fix bugs

* code clean

* support mask in softmax

* code clean

* check for shapes
```
  8da5eaaf
22 Jul, 2022 1 commit
- use legacy pytorch fuser · 0da9683c
  Guolin Ke authored Jul 22, 2022
  
  0da9683c
19 Jul, 2022 1 commit
- remaning no_ to num_ · a6ed694a
  Guolin Ke authored Jul 19, 2022
  
  a6ed694a
13 Jul, 2022 1 commit
- save memory for softmax · 3f498d32
  Guolin Ke authored Jul 13, 2022
  
  3f498d32
10 Jul, 2022 2 commits
- Update fused_adam.py · 979f972a
  Guolin Ke authored Jul 10, 2022
  
  979f972a
- first commit · 8a915496
  Guolin Ke authored Jul 10, 2022
  
  8a915496