colossalai/zero/low_level/bookkeeping/gradient_store.py · 839847b7d78bce6af5dfe58d27b5ce2c74a3619b · OpenDAS / ColossalAI · GitLab

Find file Blame History Permalink

[zero]support zero2 with gradient accumulation (#4511) · 839847b7
LuGY authored Aug 25, 2023
```
* support gradient accumulation with zero2

* fix type
```
839847b7

gradient_store.py 3.1 KB