Commits · c6d9be792928e6f0b23e7e9ae50b7e8ef19da91e · OpenDAS / fairscale

21 Oct, 2020 1 commit
- [test] moe: add a more thorough MOELayer routing test (#151) · c6d9be79
  msbaines authored Oct 20, 2020
  
  c6d9be79
17 Oct, 2020 1 commit
- [cleanup] moe: rename moelayer.py to moe_layer.py (#141) · 61234360
  msbaines authored Oct 16, 2020
  
  61234360
16 Oct, 2020 2 commits
- [feat] moe: annotate expert params (#140) · ee88bb19
  msbaines authored Oct 16, 2020
```
The expert annotation is used by clip_grads and DDP.
```
  ee88bb19
- [feat] moe: add all_to_all backward support (#137) · d99c445a
  msbaines authored Oct 16, 2020
  
  d99c445a
14 Oct, 2020 1 commit
- [feat] moe: add all_to_all support (#134) · 6d802f5a
  msbaines authored Oct 13, 2020
  
  6d802f5a
08 Oct, 2020 1 commit
- [feat] moe: initial implementation of MOELayer (#128) · 22ff665d
  msbaines authored Oct 08, 2020
```
Currently only implemented for a single process and expert.
```
  22ff665d