Commits · c626b239600f224a05c6bd2ac4bd232f10da7e8a · OpenDAS / ColossalAI · GitLab

11 Mar, 2022 4 commits
- [zero] find miss code (#378) · b5f43ace
  Jiarui Fang authored Mar 10, 2022
  
  b5f43ace
- Revert "[zero] bucketized tensor cpu gpu copy (#368)" · d9217e19
  jiaruifang authored Mar 10, 2022
```
This reverts commit bef05489b642385c80e59fe757d598efd1752ecf.
```
  d9217e19
- [zero] bucketized tensor cpu gpu copy (#368) · 00670c87
  Jiarui Fang authored Mar 10, 2022
  
  00670c87
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6
15 Feb, 2022 2 commits
- fixed mkdir conflict and align yapf config with flake (#220) · 3a1a9820
  Frank Lee authored Feb 14, 2022
  
  3a1a9820
- moved env variables to global variables; (#215) · 9ee197d0
  アマデウス authored Feb 14, 2022
```
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
```
  9ee197d0
28 Jan, 2022 1 commit

Update GitHub action and pre-commit settings (#196) · a2f15656

BoxiangW authored Jan 28, 2022

* Update GitHub action and pre-commit settings

* Update GitHub action and pre-commit settings (#198)

a2f15656