Commits · 4be0764db1b733034a80f1ba22e68cf12c282b44 · OpenDAS / FastMoE

20 Aug, 2024 2 commits
- Update test_zero.py · 4be0764d
  zhanggezhong authored Aug 20, 2024
  
  4be0764d
- Update setup.py · a8ea3fa8
  zhanggezhong authored Aug 20, 2024
  
  a8ea3fa8
19 Aug, 2024 3 commits
- Update README.md · db84d448
  zhanggezhong authored Aug 19, 2024
  
  db84d448
- change version code · da6f721a
  zhanggzh authored Aug 19, 2024
  
  da6f721a
- Update setup.py · d99ae3f2
  zhanggezhong authored Aug 19, 2024
  
  d99ae3f2
17 Aug, 2024 2 commits
- change versio code · 7561a8cb
  zhanggzh authored Aug 17, 2024
  
  7561a8cb
- change versio code · ac6a172d
  zhanggzh authored Aug 17, 2024
  
  ac6a172d
25 Jul, 2024 6 commits
- Update get_dcu_version.py · 60fb332b
  zhanggezhong authored Jul 25, 2024
  
  60fb332b
- Update setup.py · 7ff0fdfa
  zhanggezhong authored Jul 25, 2024
  
  7ff0fdfa
- Update __init__.py · 6121bbde
  zhanggezhong authored Jul 25, 2024
  
  6121bbde
- Update get_dcu_version.py · c11ff52c
  zhanggezhong authored Jul 25, 2024
  
  c11ff52c
- add hip code · 472027a2
  zhanggzh authored Jul 25, 2024
  
  472027a2
- add hip code · b446897e
  zhanggzh authored Jul 25, 2024
  
  b446897e
08 Oct, 2023 1 commit
- v1.1.0 release note · 5b602850
  Rick Ho authored Oct 08, 2023
  
  5b602850
11 Sep, 2023 9 commits
- Merge pull request #174 from laekov/fix-test · feeac050
  Rick Ho authored Sep 11, 2023
```
Fix tests
```
  feeac050
- update fmoe version · 1aedcdbf
  Rick Ho authored Sep 11, 2023
  
  1aedcdbf
- fix smart schedule shadow sync bug · dfd9b5d5
  Rick Ho authored Sep 11, 2023
  
  dfd9b5d5
- Merge pull request #172 from laekov/smgr_bug · 3a41edb8
  Rick Ho authored Sep 11, 2023
```
[BUG FIX] Fix bugs in stream manager.
```
  3a41edb8
- Merge pull request #173 from laekov/fit-new-smgr · 1f82fb16
  Rick Ho authored Sep 11, 2023
```
Fit old code with new smgr
```
  1f82fb16
- fix tests · 0a6becae
  Rick Ho authored Sep 11, 2023
  
  0a6becae
- fix shadow · 945004e7
  Rick Ho authored Sep 11, 2023
  
  945004e7
- bug fix of swipe · 226e0779
  Rick Ho authored Sep 11, 2023
  
  226e0779
- use torchstream everywhere · 4f9f77f8
  Rick Ho authored Sep 11, 2023
  
  4f9f77f8
02 Sep, 2023 1 commit
- [BUG FIX] sync torch stream before nccl send/recv · 2bd187cb
  zms1999 authored Sep 02, 2023
  
  2bd187cb
25 Aug, 2023 2 commits
- [BUG FIX] wait torch stream · ff28081c
  zms1999 authored Aug 25, 2023
  
  ff28081c
- [BUG FIX] make smart scheduling great again, fix bugs in streams management · c8633740
  zms1999 authored Aug 25, 2023
  
  c8633740
21 Aug, 2023 1 commit
- Merge pull request #171 from laekov/xptree/fix-bf16 · c1c19f3e
  Rick Ho authored Aug 21, 2023
```
fix cublas gemm call for bf16 input
```
  c1c19f3e
20 Aug, 2023 1 commit
- fix cublas gemm call for bf16 input · a7975801
  xptree authored Aug 20, 2023
  
  a7975801
30 Jul, 2023 2 commits
- Merge pull request #167 from laekov/zms-update-readme · cd8372b3
  Rick Ho authored Jul 30, 2023
```
Update outdated README
```
  cd8372b3
- Update outdated README · d3e41415
  Mingshu Zhai authored Jul 30, 2023
```
As mentioned in https://github.com/laekov/fastmoe/issues/166
```
  d3e41415
24 Jul, 2023 4 commits
- Merge pull request #165 from laekov/parallel-doc · de4ef388
  Rick Ho authored Jul 24, 2023
```
Document for process groups
```
  de4ef388
- spell check · 8bb58982
  Rick Ho authored Jul 24, 2023
  
  8bb58982
- Parallelism Document · e70726a9
  Rick Ho authored Jul 24, 2023
  
  e70726a9
- update readme and inline docstring · 02341276
  Rick Ho authored Jul 24, 2023
  
  02341276
04 Jul, 2023 1 commit
- Megatron v3.0.2 Patch (#159) · a6d202a6
  Jiezhong Qiu authored Jul 04, 2023
```
* support megatron v3.0.2

* keep num_experts for lower version of megatron
```
  a6d202a6
06 Jun, 2023 2 commits
- Merge pull request #160 from laekov/nvbf16 · d56522bc
  Mingshu Zhai authored Jun 06, 2023
```
bf16 support
```
  d56522bc
- bf16 support with test · 0bb60881
  Rick Ho authored Jun 06, 2023
  
  0bb60881
30 May, 2023 2 commits
- release note v1.0.1 · c9ccc0eb
  Rick Ho authored May 30, 2023
  
  c9ccc0eb
- Merge pull request #157 from laekov/pytorch2-compat · 1e8e455a
  Rick Ho authored May 30, 2023
```
Fix ProcessGroupNCCL mismatch in pytorch2
```
  1e8e455a
29 May, 2023 1 commit
- fix processgroupnccl mismatch in pytorch2 · 267eb9cc
  Rick Ho authored May 29, 2023
  
  267eb9cc