Commits · d520d24fdf2eb7c2e76aa5ca3020cbfd07c42910 · OpenDAS / Megatron-LM

09 Dec, 2024 1 commit
- 升级megatron_v0.10[B · 3bec6514
  xingjinliang authored Dec 09, 2024
  
  3bec6514
27 Mar, 2024 1 commit
- v1 · 051f58f1
  liangjing authored Mar 27, 2024
  
  051f58f1
23 Mar, 2023 1 commit
- Move pipeline parallel functionality into core with associated changes. · 3c92fa93
  Jared Casper authored Mar 23, 2023
  
  3c92fa93
24 Sep, 2022 1 commit
- Alias core.parallel_state as mpu and use it throughout code. RIP mpu. · 5942af97
  Jared Casper authored Sep 23, 2022
  
  5942af97
23 Sep, 2022 2 commits
- Move layers from mpu to core.tensor_parallel. · c2ea914f
  Jared Casper authored Sep 23, 2022
  
  c2ea914f
- Start Megatron-Core with vocab parallel cross entropy · 2e6a46e4
  Jared Casper authored Sep 22, 2022
```
Also merged in some changed from apex
```
  2e6a46e4