Commits · 4c06a4fd766549d3c349e8fa264dff2c49312ced · OpenDAS / Uni-Core

05 Sep, 2022 2 commits
- refine rngstate in trainer · 4c06a4fd
  Guolin Ke authored Sep 05, 2022
  
  4c06a4fd
- bug fix for rngstate with update_freq > 1. · 70dcdf17
  Guolin Ke authored Sep 05, 2022
  
  70dcdf17
27 Aug, 2022 1 commit
- rollback to torch when check bias/mask failed in softmax · 0a79672a
  Guolin Ke authored Aug 27, 2022
  
  0a79672a
26 Aug, 2022 2 commits
- fix a possible type bug in layernorm · f4ce5889
  Guolin Ke authored Aug 26, 2022
  
  f4ce5889
- remove pandas · f913d977
  Guolin Ke authored Aug 26, 2022
  
  f913d977
24 Aug, 2022 2 commits
- typo · 83602797
  Guolin Ke authored Aug 24, 2022
  
  83602797
- more layer_norm kernels · cf503760
  Guolin Ke authored Aug 24, 2022
  
  cf503760
14 Aug, 2022 5 commits
- refine installation section · e578ae25
  Guolin Ke authored Aug 14, 2022
  
  e578ae25
- rename docker folder · 5eebc0b9
  Guolin Ke authored Aug 14, 2022
  
  5eebc0b9
- refine docker build (#9) · 5551a790
  Guolin Ke authored Aug 14, 2022
```
* Update docker.yml

* py version >= 3.7

* rename docker image

* update docker file
```
  5551a790
- Add python wheel building workflow (#8) · 26d421c5
  robotcator authored Aug 14, 2022
```
* add workflow

* add name fix

* downgrade to ubuntu18.04

* remove comments
```
  26d421c5
- support old GPUS like p100 (#7) · ccf3bea4
  Guolin Ke authored Aug 14, 2022
  
  ccf3bea4
12 Aug, 2022 1 commit
- support softmax in non-inplace cases · af4f9088
  Guolin Ke authored Aug 12, 2022
  
  af4f9088
11 Aug, 2022 3 commits
- fix bug in return future mask · 49c9895b
  Guolin Ke authored Aug 11, 2022
  
  49c9895b
- fix a bug for return attn_weights · 689e0b24
  Guolin Ke authored Aug 11, 2022
  
  689e0b24
- fix bug in flatten parameters · a92c6297
  Guolin Ke authored Aug 11, 2022
  
  a92c6297
06 Aug, 2022 1 commit
- Update README.md · 9954c186
  Guolin Ke authored Aug 06, 2022
  
  9954c186
04 Aug, 2022 3 commits
- fix a silly bug · f9e22d6e
  Guolin Ke authored Aug 04, 2022
  
  f9e22d6e
- remove the limit of softmax elements · b0f52120
  Guolin Ke authored Aug 04, 2022
  
  b0f52120
- support softmax for large columns (#6) · 6c18b2ed
  Guolin Ke authored Aug 04, 2022
```
* support softmax for large columns

* more tests
```
  6c18b2ed
30 Jul, 2022 1 commit
- support gradient checkpointing · 31fe887e
  Guolin Ke authored Jul 30, 2022
  
  31fe887e
28 Jul, 2022 1 commit
- flatten parameters (#4) · 89ac1b7b
  Guolin Ke authored Jul 28, 2022
```
flatten memories
```
  89ac1b7b
27 Jul, 2022 1 commit
- fix softmax cpu · 1e8b6e33
  Guolin Ke authored Jul 27, 2022
  
  1e8b6e33
24 Jul, 2022 2 commits
- warning about missing keys in loading model · 21cb6b39
  Guolin Ke authored Jul 24, 2022
  
  21cb6b39
- support softmax with bias and mask (#2) · 8da5eaaf
  Guolin Ke authored Jul 24, 2022
```
* try

* fix bugs

* code clean

* support mask in softmax

* code clean

* check for shapes
```
  8da5eaaf
22 Jul, 2022 1 commit
- use legacy pytorch fuser · 0da9683c
  Guolin Ke authored Jul 22, 2022
  
  0da9683c
19 Jul, 2022 1 commit
- remaning no_ to num_ · a6ed694a
  Guolin Ke authored Jul 19, 2022
  
  a6ed694a
13 Jul, 2022 1 commit
- save memory for softmax · 3f498d32
  Guolin Ke authored Jul 13, 2022
  
  3f498d32
12 Jul, 2022 1 commit
- add pandas · 97fd9948
  Guolin Ke authored Jul 12, 2022
  
  97fd9948
11 Jul, 2022 1 commit
- Update Dockerfile · 3e935d9d
  Guolin Ke authored Jul 11, 2022
  
  3e935d9d
10 Jul, 2022 7 commits
- Update docker.yml · 552e8b25
  Guolin Ke authored Jul 10, 2022
  
  552e8b25
- Update fused_adam.py · 979f972a
  Guolin Ke authored Jul 10, 2022
  
  979f972a
- Update docker.yml · 8e50c5d4
  Guolin Ke authored Jul 10, 2022
  
  8e50c5d4
- Update docker.yml · a1dff9ba
  Guolin Ke authored Jul 10, 2022
  
  a1dff9ba
- add docker workflow (#1) · 10996580
  Guolin Ke authored Jul 10, 2022
  
  10996580
- first commit · 8a915496
  Guolin Ke authored Jul 10, 2022
  
  8a915496
- gitignore · 5cf7df97
  Guolin Ke authored Jul 10, 2022
  
  5cf7df97