Commits · df715c9ff4963dfd69d1ddd6366d5ff1cc4cf743 · OpenDAS / FastMoE

21 Mar, 2023 1 commit
- support n_expert > 1 for FasterMoE smart scheduling and expert shadowing · 14878015
  zms1999 authored Mar 21, 2023
  
  14878015
20 Mar, 2023 1 commit
- patch for megatron v2.5 · b31b7e3f
  zms1999 authored Mar 21, 2023
  
  b31b7e3f
28 Mar, 2022 1 commit
- fix document for megatron · 7bdf58c9
  Rick Ho authored Mar 28, 2022
  
  7bdf58c9
26 Oct, 2021 1 commit
- fix megatron adapter for swipe · 57bdfe88
  Rick Ho authored Oct 26, 2021
  
  57bdfe88
12 Oct, 2021 1 commit
- update calculation for megatron hhs · ae10e942
  Rick Ho authored Oct 12, 2021
  
  ae10e942
10 Oct, 2021 1 commit
- tide up megatron compatible layer · 5f8ba136
  Rick Ho authored Oct 10, 2021
  
  5f8ba136
07 Jul, 2021 1 commit
- add moe_comm · 18a4395c
  Rick Ho authored Jul 08, 2021
  
  18a4395c
31 May, 2021 1 commit
- Adapt balance loss for new gate interface & update patch · 4eec9807
  Sengxian authored May 31, 2021
  
  4eec9807
22 Mar, 2021 1 commit
- initial split · b690f245
  Rick Ho authored Mar 22, 2021
  
  b690f245