Commits · f27d801a13c2feed37ea676e38c6ef8831d58e76 · OpenDAS / ColossalAI

"docs/source/zh-Hans/vscode:/vscode.git/clone" did not exist on "db40e086c876bd7b84155e9104b849d8556a84e9"

18 Mar, 2022 2 commits
- [test] optimized zero data parallel test (#452) · f27d801a
  Frank Lee authored Mar 18, 2022
  
  f27d801a
- [Bot] Automated submodule synchronization (#451) · cfcc8271
  github-actions[bot] authored Mar 18, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  cfcc8271
17 Mar, 2022 9 commits
- [DevOps] remove unneeded dependency in build workflow (#449) · ac4513c5
  Frank Lee authored Mar 17, 2022
  
  ac4513c5
- [test] make zero engine test really work (#447) · 0fcfb1e0
  Jiarui Fang authored Mar 17, 2022
  
  0fcfb1e0
- optimize engine and trainer test (#448) · bb2790cf
  Frank Lee authored Mar 17, 2022
  
  bb2790cf
- [zero] hybrid cpu adam (#445) · 237d08e7
  Jiarui Fang authored Mar 17, 2022
  
  237d08e7
- optimized context test time consumption (#446) · b72b8445
  Frank Lee authored Mar 17, 2022
  
  b72b8445
- [hotfix] fix initialize bug with zero (#442) · 496cbb07
  Jiarui Fang authored Mar 17, 2022
  
  496cbb07
- update github CI with the current workflow (#441) · 725a39f4
  Frank Lee authored Mar 17, 2022
  
  725a39f4
- update contributing.md with the current workflow (#440) · 5a1e33b9
  Frank Lee authored Mar 17, 2022
  
  5a1e33b9
- [unitest] polish zero config in unittest (#438) · 17b8274f
  Jiarui Fang authored Mar 17, 2022
  
  17b8274f
16 Mar, 2022 14 commits
- [refactory] refactory the initialize method for new zero design (#431) · 640a6cd3
  Jiarui Fang authored Mar 16, 2022
  
  640a6cd3
- [misc] replace codebeat with codefactor on readme (#436) · 4f85b687
  Frank Lee authored Mar 16, 2022
  
  4f85b687
- added testing module (#435) · bffd85bf
  Frank Lee authored Mar 16, 2022
  
  bffd85bf
- added Multiply Jitter and capacity factor eval for MOE (#434) · dbdc9a77
  HELSON authored Mar 16, 2022
  
  dbdc9a77
- fixed mem monitor device (#433) · b03b3ae9
  Frank Lee authored Mar 16, 2022
```
fixed mem monitor device
```
  b03b3ae9
- fixed fp16 optimizer none grad bug (#432) · 14a70942
  Frank Lee authored Mar 16, 2022
  
  14a70942
- sync before creating empty grad · fce9432f
  ver217 authored Mar 16, 2022
  
  fce9432f
- free param.grad · ea6905a8
  ver217 authored Mar 15, 2022
  
  ea6905a8
- use double buffer to handle grad · 9506a8be
  ver217 authored Mar 15, 2022
  
  9506a8be
- fixed gpt attention mask in pipeline (#430) · 0f5f5dd5
  Frank Lee authored Mar 16, 2022
  
  0f5f5dd5
- [test] merge zero optim tests (#428) · f9c762df
  Jiarui Fang authored Mar 16, 2022
  
  f9c762df
- [polish] add license meta to setup.py (#427) · f0d6e220
  Frank Lee authored Mar 16, 2022
  
  f0d6e220
- [hotfix] run cpu adam unittest in pytest (#424) · 5d7dc352
  Jiarui Fang authored Mar 16, 2022
  
  5d7dc352
- [log] better logging display with rich (#426) · 54229cd3
  Jiarui Fang authored Mar 16, 2022
```
* better logger using rich

* remove deepspeed in zero requirements
```
  54229cd3
15 Mar, 2022 5 commits
- removed noisy function during evaluation of MoE router (#419) · 3f70a2b1
  HELSON authored Mar 15, 2022
  
  3f70a2b1
- [zero] cuda margin space for OS (#418) · adebb3e0
  Jiarui Fang authored Mar 15, 2022
  
  adebb3e0
- [polish] use GLOBAL_MODEL_DATA_TRACER (#417) · 56bb412e
  Jiarui Fang authored Mar 15, 2022
  
  56bb412e
- [zero] refactory ShardedOptimV2 init method (#416) · 23ba3fc4
  Jiarui Fang authored Mar 15, 2022
  
  23ba3fc4
- [fp16] refactored fp16 optimizer (#392) · e79ea442
  Frank Lee authored Mar 15, 2022
  
  e79ea442
14 Mar, 2022 10 commits
- Merge pull request #412 from hpcaitech/develop · f8a0e7fb
  Frank Lee authored Mar 14, 2022
```
merge develop to main
```
  f8a0e7fb
- [zero] memtracer to record cuda memory usage of model data and overall system (#395) · 21dc54e0
  Jiarui Fang authored Mar 14, 2022
  
  21dc54e0
- [hotfix] rm test_tensor_detector.py (#413) · a37bf1bc
  Jiarui Fang authored Mar 14, 2022
  
  a37bf1bc
- [zero] new interface for ShardedOptimv2 (#406) · 370f567e
  Jiarui Fang authored Mar 14, 2022
  
  370f567e
- Added tensor detector (#393) · a9c27be4
  LuGY authored Mar 14, 2022
```
* Added tensor detector

* Added the - states

* Allowed change include_cpu when detect()
```
  a9c27be4
- Merge pull request #409 from 1SAA/develop · 32296cf4
  Frank Lee authored Mar 14, 2022
```
[hotfix] fixed error when no collective communication in CommProfiler
```
  32296cf4
- fixed error when no collective communication in CommProfiler · 907ac4a2
  1SAA authored Mar 14, 2022
  
  907ac4a2
- update hf badge link (#410) · 62b08acc
  Frank Lee authored Mar 14, 2022
  
  62b08acc
- Merge pull request #403 from ver217/feature/shard-strategy · 2fe68b35
  Frank Lee authored Mar 14, 2022
```
[zero] Add bucket tensor shard strategy
```
  2fe68b35
- added huggingface badge (#407) · cf92a779
  Frank Lee authored Mar 14, 2022
  
  cf92a779