src/diffusers/models/modeling_utils.py · ddd0cfb497e5c0c7f5dea6ba79dc97763d8d8f9a · renzhc / diffusers_dcu

[feat] implement `record_stream` when using CUDA streams during group offloading (#11081) · 4b27c4a4

Sayak Paul authored Apr 08, 2025



* implement record_stream for better performance.

* fix

* style.

* merge #11097

* Update src/diffusers/hooks/group_offloading.py
Co-authored-by: Aryan <aryan@huggingface.co>

* fixes

* docstring.

* remaining todos in low_cpu_mem_usage

* tests

* updates to docs.

---------
Co-authored-by: Aryan <aryan@huggingface.co>

4b27c4a4

modeling_utils.py 81.7 KB

Replace modeling_utils.py