Commits · 49a3d9bc0bbd16a9d17b0f2cb768e8456ed96152 · OpenDAS / fairscale

"sgl-router/vscode:/vscode.git/clone" did not exist on "5fbad308cdbc9702ee1c4e8843016a5c2716bcc1"

17 Oct, 2020 1 commit
- [cleanup] moe: rename moelayer.py to moe_layer.py (#141) · 61234360
  msbaines authored Oct 16, 2020
  
  61234360
16 Oct, 2020 2 commits
- [feat] moe: annotate expert params (#140) · ee88bb19
  msbaines authored Oct 16, 2020
```
The expert annotation is used by clip_grads and DDP.
```
  ee88bb19
- [feat] moe: add all_to_all backward support (#137) · d99c445a
  msbaines authored Oct 16, 2020
  
  d99c445a
14 Oct, 2020 1 commit
- [feat] moe: add all_to_all support (#134) · 6d802f5a
  msbaines authored Oct 13, 2020
  
  6d802f5a
08 Oct, 2020 1 commit
- [feat] moe: initial implementation of MOELayer (#128) · 22ff665d
  msbaines authored Oct 08, 2020
```
Currently only implemented for a single process and expert.
```
  22ff665d