tests/fsdp/test_fsdp.py · f16caf44bb1606652ac6c7c4ad4bf44973d4e545 · chenpangpang / transformers

"lightx2v/models/vscode:/vscode.git/clone" did not exist on "3fb9aa7e0d89ce29b6b39f38c609c8b4988921ca"

Add FSDP config for CPU RAM efficient loading through accelerate (#30002) · f16caf44

Howard Liberty authored Apr 22, 2024



* Add FSDP config for CPU RAM efficient loading

* Style fix

* Update src/transformers/training_args.py
Co-authored-by: Zach Mueller <muellerzr@gmail.com>

* Update src/transformers/training_args.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Add sync_module_states and cpu_ram_efficient_loading validation logic

* Update src/transformers/training_args.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Style

---------
Co-authored-by: Zach Mueller <muellerzr@gmail.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

f16caf44

test_fsdp.py 13.4 KB

Replace test_fsdp.py