Commits · e1282c1420bd5f88c0bde29709698daf558166f7 · OpenDAS / FastMoE

30 May, 2025 2 commits
- Update __init__.py · e1282c14
  zhanggezhong authored May 30, 2025
  
  e1282c14
- Update README.md · d4b43b45
  zhanggezhong authored May 30, 2025
  
  d4b43b45
27 May, 2025 2 commits
- add fastmoe src code and change readme · 01d93520
  zhanggzh authored May 27, 2025
  
  01d93520
- change test_ddp src code · 717f02f3
  zhanggzh authored May 27, 2025
  
  717f02f3
08 Oct, 2023 1 commit
- v1.1.0 release note · 5b602850
  Rick Ho authored Oct 08, 2023
  
  5b602850
11 Sep, 2023 9 commits
- Merge pull request #174 from laekov/fix-test · feeac050
  Rick Ho authored Sep 11, 2023
```
Fix tests
```
  feeac050
- update fmoe version · 1aedcdbf
  Rick Ho authored Sep 11, 2023
  
  1aedcdbf
- fix smart schedule shadow sync bug · dfd9b5d5
  Rick Ho authored Sep 11, 2023
  
  dfd9b5d5
- Merge pull request #172 from laekov/smgr_bug · 3a41edb8
  Rick Ho authored Sep 11, 2023
```
[BUG FIX] Fix bugs in stream manager.
```
  3a41edb8
- Merge pull request #173 from laekov/fit-new-smgr · 1f82fb16
  Rick Ho authored Sep 11, 2023
```
Fit old code with new smgr
```
  1f82fb16
- fix tests · 0a6becae
  Rick Ho authored Sep 11, 2023
  
  0a6becae
- fix shadow · 945004e7
  Rick Ho authored Sep 11, 2023
  
  945004e7
- bug fix of swipe · 226e0779
  Rick Ho authored Sep 11, 2023
  
  226e0779
- use torchstream everywhere · 4f9f77f8
  Rick Ho authored Sep 11, 2023
  
  4f9f77f8
02 Sep, 2023 1 commit
- [BUG FIX] sync torch stream before nccl send/recv · 2bd187cb
  zms1999 authored Sep 02, 2023
  
  2bd187cb
25 Aug, 2023 2 commits
- [BUG FIX] wait torch stream · ff28081c
  zms1999 authored Aug 25, 2023
  
  ff28081c
- [BUG FIX] make smart scheduling great again, fix bugs in streams management · c8633740
  zms1999 authored Aug 25, 2023
  
  c8633740
21 Aug, 2023 1 commit
- Merge pull request #171 from laekov/xptree/fix-bf16 · c1c19f3e
  Rick Ho authored Aug 21, 2023
```
fix cublas gemm call for bf16 input
```
  c1c19f3e
20 Aug, 2023 1 commit
- fix cublas gemm call for bf16 input · a7975801
  xptree authored Aug 20, 2023
  
  a7975801
30 Jul, 2023 2 commits
- Merge pull request #167 from laekov/zms-update-readme · cd8372b3
  Rick Ho authored Jul 30, 2023
```
Update outdated README
```
  cd8372b3
- Update outdated README · d3e41415
  Mingshu Zhai authored Jul 30, 2023
```
As mentioned in https://github.com/laekov/fastmoe/issues/166
```
  d3e41415
24 Jul, 2023 4 commits
- Merge pull request #165 from laekov/parallel-doc · de4ef388
  Rick Ho authored Jul 24, 2023
```
Document for process groups
```
  de4ef388
- spell check · 8bb58982
  Rick Ho authored Jul 24, 2023
  
  8bb58982
- Parallelism Document · e70726a9
  Rick Ho authored Jul 24, 2023
  
  e70726a9
- update readme and inline docstring · 02341276
  Rick Ho authored Jul 24, 2023
  
  02341276
04 Jul, 2023 1 commit
- Megatron v3.0.2 Patch (#159) · a6d202a6
  Jiezhong Qiu authored Jul 04, 2023
```
* support megatron v3.0.2

* keep num_experts for lower version of megatron
```
  a6d202a6
06 Jun, 2023 2 commits
- Merge pull request #160 from laekov/nvbf16 · d56522bc
  Mingshu Zhai authored Jun 06, 2023
```
bf16 support
```
  d56522bc
- bf16 support with test · 0bb60881
  Rick Ho authored Jun 06, 2023
  
  0bb60881
30 May, 2023 2 commits
- release note v1.0.1 · c9ccc0eb
  Rick Ho authored May 30, 2023
  
  c9ccc0eb
- Merge pull request #157 from laekov/pytorch2-compat · 1e8e455a
  Rick Ho authored May 30, 2023
```
Fix ProcessGroupNCCL mismatch in pytorch2
```
  1e8e455a
29 May, 2023 1 commit
- fix processgroupnccl mismatch in pytorch2 · 267eb9cc
  Rick Ho authored May 29, 2023
  
  267eb9cc
21 May, 2023 5 commits
- Merge pull request #155 from santurini/patch-3 · 9fe65ec0
  Rick Ho authored May 21, 2023
```
Added link to installation guide
```
  9fe65ec0
- Merge pull request #154 from santurini/patch-2 · 2ec2f14a
  Rick Ho authored May 21, 2023
```
Create installation-guide.md
```
  2ec2f14a
- Added link to installation guide · 7817fa15
  Arturo Ghinassi authored May 21, 2023
  
  7817fa15
- Reviewed following @laekov suggestions · 3eabb02f
  Arturo Ghinassi authored May 21, 2023
  
  3eabb02f
- Create installation-guide.md · cb74e2f6
  Arturo Ghinassi authored May 21, 2023
```
Added installation tutorial in the documentation
```
  cb74e2f6
19 May, 2023 4 commits
- Merge pull request #152 from santurini/patch-1 · 50ac47f9
  Rick Ho authored May 19, 2023
```
Cast input to weights type for AMP support
```
  50ac47f9
- Cast input to weights type for AMP support · af8c4737
  Arturo Ghinassi authored May 19, 2023
  
  af8c4737
- Merge pull request #151 from laekov/revert-150-patch-1 · a31fcc55
  Rick Ho authored May 19, 2023
```
Revert "convert input to same type as weight for mixed precision training"
```
  a31fcc55
- Revert "convert input to same type as weight for mixed precision training" · f1a6e6fd
  Rick Ho authored May 19, 2023
  
  f1a6e6fd