Commits · d56522bc3541bfc60292b88bf1b8436ec88713f7 · OpenDAS / FastMoE

06 Jun, 2023 1 commit
- bf16 support with test · 0bb60881
  Rick Ho authored Jun 06, 2023
  
  0bb60881
21 Mar, 2023 1 commit
- support n_expert > 1 for FasterMoE smart scheduling and expert shadowing · 14878015
  zms1999 authored Mar 21, 2023
  
  14878015
20 Mar, 2023 1 commit
- patch for megatron v2.5 · b31b7e3f
  zms1999 authored Mar 21, 2023
  
  b31b7e3f
28 Dec, 2022 1 commit
- cudaStreamWaitEvent compat · 25e9324f
  Rick Ho authored Dec 28, 2022
  
  25e9324f
30 Apr, 2022 1 commit
- skip computeFn when micro_batch_size == 0 · 2ce87038
  zms1999 authored Apr 30, 2022
  
  2ce87038
31 Mar, 2022 1 commit
- expert shadow backward with test · 794dd0e6
  Rick Ho authored Mar 31, 2022
  
  794dd0e6
30 Mar, 2022 3 commits
- forward tested · b5b72d41
  Rick Ho authored Mar 30, 2022
  
  b5b72d41
- forward code in smart schedule · 771dc62d
  Rick Ho authored Mar 30, 2022
  
  771dc62d
- fix potential stream synchronization issue · ad651f03
  Rick Ho authored Mar 30, 2022
  
  ad651f03
29 Mar, 2022 3 commits
- fix backward grad weight bug · 6c68b56b
  Rick Ho authored Mar 30, 2022
  
  6c68b56b
- backward bugous on grad weight · a807e2a3
  Rick Ho authored Mar 29, 2022
  
  a807e2a3
- forward pass test · 46c3722d
  Rick Ho authored Mar 29, 2022
  
  46c3722d