Commits · 238d2e3c44366aba9dc5c770c95475765a6725cb · chenpangpang / transformers

16 Dec, 2023 1 commit
- fix resuming from ckpt when using FSDP with FULL_STATE_DICT (#27891) · 238d2e3c
  Sourab Mangrulkar authored Dec 16, 2023
```
* fix resuming from ckpt when suing FSDP with FULL_STATE_DICT

* update tests

* fix tests
```
  238d2e3c
01 Nov, 2023 1 commit
- device agnostic fsdp testing (#27120) · 82c7e879
  Hz, Ji authored Nov 01, 2023
```
* make fsdp test cases device agnostic

* make style
```
  82c7e879
12 Oct, 2023 1 commit
- Skip `TrainerIntegrationFSDP::test_basic_run_with_cpu_offload` if `torch < 2.1` (#26764) · 3e93dd29
  Yih-Dar authored Oct 12, 2023
```
* fix

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  3e93dd29
20 Sep, 2023 2 commits

fix name error when accelerate is not available (#26278) · 86ffd5ff
Sourab Mangrulkar authored Sep 20, 2023
```
* fix name error when accelerate is not available

* fix `is_fsdp_available`
```
86ffd5ff

FSDP tests and checkpointing fixes (#26180) · 382ba670

Sourab Mangrulkar authored Sep 20, 2023



* add fsdp tests

* Update test_fsdp.py

* Update test_fsdp.py

* fixes

* checks

* Update trainer.py

* fix

* fixes for saving/resuming checkpoints

* fixes

* add tests and delete debug statements

* fixing tests

* Update test_fsdp.py

* fix tests

* fix tests

* minor nits

* fix code style and quality

* refactor and modularize test code

* reduce the time of tests

* reduce the test time

* fix test

* reduce test time

* reduce test time

* fix failing tests

* fix

* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* resolve comments

---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

382ba670