Commits · 9f8d8cd8726c8478a8d171798975d51a335033ec · OpenDAS / FastMoE

06 Dec, 2020 2 commits
- softmax rather than relu · 9f8d8cd8
  Jiezhong Qiu authored Dec 07, 2020
  
  9f8d8cd8
- residual in hmoe · 51361a3f
  Jiezhong Qiu authored Dec 06, 2020
  
  51361a3f
25 Nov, 2020 1 commit
- recover sparse ffn · 823f9c2e
  Jiezhong Qiu authored Nov 25, 2020
  
  823f9c2e
23 Nov, 2020 5 commits
- add gate · 0f3e63eb
  Jiezhong Qiu authored Nov 23, 2020
  
  0f3e63eb
- update · a43caff7
  Jiezhong Qiu authored Nov 23, 2020
  
  a43caff7
- fix · 4f7a182b
  Jiezhong Qiu authored Nov 23, 2020
  
  4f7a182b
- update · 103c6395
  Jiezhong Qiu authored Nov 23, 2020
  
  103c6395
- hmoe · 19ee0ff2
  Jiezhong Qiu authored Nov 23, 2020
  
  19ee0ff2
19 Nov, 2020 3 commits
- fix · 3bdbb28d
  Jiezhong Qiu authored Nov 19, 2020
  
  3bdbb28d
- torch sparse for spmm · 1b7cbeb5
  Jiezhong Qiu authored Nov 19, 2020
  
  1b7cbeb5
- fix bug · 47167bcc
  Jiezhong Qiu authored Nov 19, 2020
  
  47167bcc
18 Nov, 2020 2 commits
- fix · 82fe21d3
  Jiezhong Qiu authored Nov 19, 2020
  
  82fe21d3
- multihead ffn · 37d01e9c
  Jiezhong Qiu authored Nov 18, 2020
  
  37d01e9c
14 Nov, 2020 1 commit
- profile sparsity of relu output in ffn · cf8a61d8
  Jiezhong Qiu authored Nov 14, 2020
  
  cf8a61d8
08 Nov, 2020 1 commit
- add mem2mem attention · 958c714e
  Jiezhong Qiu authored Nov 08, 2020
  
  958c714e
09 Jan, 2019 1 commit
- init · 3a0086fa
  Zhilin Yang authored Jan 10, 2019
  
  3a0086fa