Commits · bc0e271e7179ff9e44fdaa15c0c822a6fe1d0ab8 · OpenDAS / ColossalAI

23 Dec, 2022 2 commits
- [buider] use builder() for cpu adam and fused optim in setup.py (#2187) · bc0e271e
  Jiarui Fang authored Dec 23, 2022
  
  bc0e271e
- [builder] runtime adam and fused_optim builder (#2184) · d42afd30
  Jiarui Fang authored Dec 23, 2022
  
  d42afd30
12 Dec, 2022 1 commit

[optimizer] add div_scale for optimizers (#2117) · e7d3afc9

HELSON authored Dec 12, 2022

* [optimizer] add div_scale for optimizers

* [zero] use div_scale in zero optimizer

* fix testing error

e7d3afc9

17 Nov, 2022 1 commit
- [kernel] move all symlinks of kernel to `colossalai._C` (#1971) · f8a7148d
  ver217 authored Nov 17, 2022
  
  f8a7148d
05 Aug, 2022 1 commit
- [hotfix] fix CPUAdam kernel nullptr (#1410) · 12b48870
  ver217 authored Aug 05, 2022
  
  12b48870
26 Jul, 2022 1 commit

[nvme] CPUAdam and HybridAdam support NVMe offload (#1360) · c415240d

ver217 authored Jul 26, 2022

* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI

c415240d

25 Mar, 2022 2 commits
- [zero]added hybrid adam, removed loss scale in adam (#527) · 105c5301
  LuGY authored Mar 25, 2022
```
* [zero]added hybrid adam, removed loss scale of adam

* remove useless code
```
  105c5301
- [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) · 6a3f9fda
  LuGY authored Mar 25, 2022
  
  6a3f9fda
16 Mar, 2022 1 commit
- [hotfix] run cpu adam unittest in pytest (#424) · 5d7dc352
  Jiarui Fang authored Mar 16, 2022
  
  5d7dc352
11 Mar, 2022 1 commit

[zero] cpu adam kernel (#288) · a3269de5

LuGY authored Mar 04, 2022



* Added CPU Adam

* finished the cpu adam

* updated the license

* delete useless parameters, removed resnet

* modified the method off cpu adam unittest

* deleted some useless codes

* removed useless codes
Co-authored-by: ver217 <lhx0217@gmail.com>
Co-authored-by: Frank Lee <somerlee.9@gmail.com>
Co-authored-by: jiaruifang <fangjiarui123@gmail.com>

a3269de5