Commits · eb4333f09cea2f85e3d1856e943474f732fc289f · evt_fugx1 / dcu_megatron

14 May, 2025 2 commits
- 添加reproduce功能, 开启后可实现训练loss完全复现, 少量降低训练性能 · eb4333f0
  wangxj authored May 14, 2025
  
  eb4333f0
- update model parameters format · 57944e55
  silencealiang authored May 14, 2025
  
  57944e55
12 May, 2025 2 commits
- Update run_llama2_7B_1nodes.sh · 90ae7f5c
  silencealiang authored May 12, 2025
  
  90ae7f5c
- fix llama2 bug and update file format · fe0b03b5
  silencealiang authored May 12, 2025
  
  fe0b03b5
07 May, 2025 1 commit
- Update deepseekv3 parameters to avoid expert select fault · ee3ff5df
  silencealiang authored May 07, 2025
  
  ee3ff5df
06 May, 2025 1 commit
- Update train_deepseekv3_671B_multinodes.sh · b85974a6
  silencealiang authored May 06, 2025
  
  b85974a6
30 Apr, 2025 2 commits
- update · 48cf4c79
  silencealiang authored Apr 30, 2025
  
  48cf4c79
- update model parameters · 70368616
  silencealiang authored Apr 30, 2025
  
  70368616
29 Apr, 2025 2 commits
- bug fix · 8551c38e
  silencealiang authored Apr 29, 2025
  
  8551c38e
- patch for megatron 4429e8ebe · a8a2bbea
  dongcl authored Apr 29, 2025
  
  a8a2bbea
25 Apr, 2025 1 commit
- 删除llama2_7b.sh · 2ddbd4be
  dongcl authored Apr 25, 2025
  
  2ddbd4be
21 Apr, 2025 1 commit
- Megatron v0.11.0 · ce02cd51
  dongcl authored Apr 21, 2025
  
  ce02cd51
15 Apr, 2025 1 commit
- 修改lightop的rmsnorm和补充脚本 · c1200c81
  wangxj authored Apr 15, 2025
  
  c1200c81
14 Apr, 2025 1 commit
- 修复rmsnorm的bug · b6eb1484
  wangxj authored Apr 14, 2025
  
  b6eb1484
11 Apr, 2025 1 commit
- Update train_gpt_567B_1nodes.sh · e45e6793
  silencealiang authored Apr 11, 2025
  
  e45e6793
10 Apr, 2025 1 commit
- Update train_gpt_567B_1nodes.sh · 6f016785
  silencealiang authored Apr 10, 2025
  
  6f016785
07 Apr, 2025 2 commits
- add MEGATRON_PATH · b0b00f4a
  silencealiang authored Apr 07, 2025
  
  b0b00f4a
- Add Megatron-LM submodule at tag v0.11.0 · 75e4a736
  silencealiang authored Apr 07, 2025
  
  75e4a736