Commits · 95ddbc19fe68ac355fbc0bc393062b1d44a080ae · OpenDAS / fairscale

21 Oct, 2020 1 commit
- [test] moe: add a more thorough MOELayer routing test (#151) · c6d9be79
  msbaines authored Oct 20, 2020
  
  c6d9be79
17 Oct, 2020 1 commit
- [cleanup] moe: rename moelayer.py to moe_layer.py (#141) · 61234360
  msbaines authored Oct 16, 2020
  
  61234360
16 Oct, 2020 2 commits
- [feat] moe: annotate expert params (#140) · ee88bb19
  msbaines authored Oct 16, 2020
```
The expert annotation is used by clip_grads and DDP.
```
  ee88bb19
- [feat] moe: add all_to_all backward support (#137) · d99c445a
  msbaines authored Oct 16, 2020
  
  d99c445a
14 Oct, 2020 1 commit
- [feat] moe: add all_to_all support (#134) · 6d802f5a
  msbaines authored Oct 13, 2020
  
  6d802f5a
08 Oct, 2020 1 commit
- [feat] moe: initial implementation of MOELayer (#128) · 22ff665d
  msbaines authored Oct 08, 2020
```
Currently only implemented for a single process and expert.
```
  22ff665d
05 Oct, 2020 1 commit
- [fix] moe: fix Top2Gate to work on GPU (#124) · 662667d0
  msbaines authored Oct 05, 2020
  
  662667d0
02 Oct, 2020 1 commit
- [feat] moe: initial implementation of Top2Gating (#118) · 7815f6f3
  msbaines authored Oct 01, 2020
  
  7815f6f3