Commits · 899c20e89e3d9710d514a064eaf045194b9c2e36 · OpenDAS / Megatron-LM

20 Mar, 2025 2 commits
- 优化legacy的定长fa接口 · 899c20e8
  wangxj authored Mar 20, 2025
  
  899c20e8
- update · 9dabea91
  silencealiang authored Mar 20, 2025
  
  9dabea91
19 Mar, 2025 4 commits
- Upload New File · 66d982b8
  wxj authored Mar 19, 2025
  
  66d982b8
- Upload New File · b20130a5
  wxj authored Mar 19, 2025
  
  b20130a5
- fix spelling · d1faf734
  silencealiang authored Mar 19, 2025
  
  d1faf734
- fix bug · b3233ef9
  silencealiang authored Mar 19, 2025
  
  b3233ef9
17 Mar, 2025 1 commit
- 添加legacy的优化项和llama示例脚本 · f43ec2dd
  wangxj authored Mar 17, 2025
  
  f43ec2dd
14 Mar, 2025 7 commits
- 添加legacy的优化项和llama示例脚本 · 2a23c48c
  wangxj authored Mar 14, 2025
  
  2a23c48c
- 修改执行路径 · 8216df28
  silencealiang authored Mar 14, 2025
  
  8216df28
- fix spelling bug · f7aaf737
  silencealiang authored Mar 14, 2025
  
  f7aaf737
- fix spelling bug · 92fdedff
  silencealiang authored Mar 14, 2025
  
  92fdedff
- fix spelling bug · c941a435
  silencealiang authored Mar 14, 2025
  
  c941a435
- fix spelling bug · 55b3f6d5
  silencealiang authored Mar 14, 2025
  
  55b3f6d5
- 更新代码 · 688448db
  silencealiang authored Mar 14, 2025
  
  688448db
25 Dec, 2024 1 commit
- 同步最新代码 · 99a0c39e
  xingjinliang authored Dec 25, 2024
  
  99a0c39e
09 Dec, 2024 1 commit
- 升级megatron_v0.10[B · 3bec6514
  xingjinliang authored Dec 09, 2024
  
  3bec6514
27 Mar, 2024 1 commit
- v1 · 051f58f1
  liangjing authored Mar 27, 2024
  
  051f58f1
23 Mar, 2023 1 commit
- Move pipeline parallel functionality into core with associated changes. · 3c92fa93
  Jared Casper authored Mar 23, 2023
  
  3c92fa93
09 Mar, 2023 1 commit
- Fix GPT text generation · 3c760180
  Maanu Grover authored Mar 09, 2023
  
  3c760180
22 Feb, 2023 1 commit
- Retro · 17a6044d
  Lawrence McAfee authored Feb 21, 2023
  
  17a6044d
17 Feb, 2023 2 commits
- Fix distributed pretraining examples · 94dbfd1c
  Maanu Grover authored Feb 17, 2023
  
  94dbfd1c
- Fix pretraining examples · 7625a9d2
  Maanu Grover authored Feb 17, 2023
  
  7625a9d2
24 Nov, 2022 1 commit
- Open sourcing lm detoxification code · d48d95ab
  Boxin Wang authored Nov 23, 2022
  
  d48d95ab
19 May, 2022 1 commit
- Update readme with sequence parallelism and selective activation recompute. · b83477a3
  Jared Casper authored May 19, 2022
  
  b83477a3
17 Feb, 2022 3 commits
- Don't need an example for Switch networks until it's more polished · d7bf1ab5
  rprenger authored Feb 17, 2022
  
  d7bf1ab5
- removed slurm commands; added 'num-experts' · 3237cc33
  Lawrence McAfee authored Feb 17, 2022
  
  3237cc33
- moved run.sh -> examples/ · c8e4cdae
  Lawrence McAfee authored Feb 17, 2022
  
  c8e4cdae
22 Jan, 2022 1 commit
- fix an argument · 313730e9
  Jay authored Jan 22, 2022
  
  313730e9
14 Dec, 2021 1 commit
- change directory name to msdp · b8707ee2
  zihanl authored Dec 13, 2021
  
  b8707ee2
10 Dec, 2021 3 commits
- Updated readme · 290ad54d
  Mostofa Patwary authored Dec 10, 2021
  
  290ad54d
- added additional README · da6c05be
  Mostofa Patwary authored Dec 10, 2021
  
  da6c05be
- add knwl_dialo scripts · e755f6fd
  zihanl authored Dec 09, 2021
  
  e755f6fd
27 Nov, 2021 1 commit
- add preprocessing · a79820a6
  zihanl authored Nov 27, 2021
  
  a79820a6
26 Nov, 2021 1 commit
- update knowledgeable dialogue running script · 492fdf83
  zihanl authored Nov 25, 2021
  
  492fdf83
08 Oct, 2021 1 commit
- Update text generation section of README. Fix line continuation in example scripts. · a2cde4b3
  Jared Casper authored Oct 08, 2021
  
  a2cde4b3
27 Aug, 2021 2 commits
- Adding API server · 3fe6821a
  Ryan Prenger authored Aug 27, 2021
  
  3fe6821a
- Removing NVIDIA specific code and fixing some whitespace · e718810e
  rprenger authored Aug 27, 2021
  
  e718810e
26 Aug, 2021 1 commit
- Addressing comments · 055a673e
  rprenger authored Aug 25, 2021
  
  055a673e
19 Aug, 2021 2 commits
- more updates on examples · 6985e589
  slym authored Aug 18, 2021
  
  6985e589
- Checkpoint a set number of invidividual Transformer layers · c1e0689d
  slym authored Aug 10, 2021
```
consider the case of pipeline-model prallelism

clean up arugments

argument naming cleanup

update readme and examples
```
  c1e0689d