• Marc Sun's avatar
    [FEAT] DDUF format (#10037) · fbff43ac
    Marc Sun authored
    
    
    * load and save dduf archive
    
    * style
    
    * switch to zip uncompressed
    
    * updates
    
    * Update src/diffusers/pipelines/pipeline_utils.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * Update src/diffusers/pipelines/pipeline_utils.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * first draft
    
    * remove print
    
    * switch to dduf_file for consistency
    
    * switch to huggingface hub api
    
    * fix log
    
    * add a basic test
    
    * Update src/diffusers/configuration_utils.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * Update src/diffusers/pipelines/pipeline_utils.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * Update src/diffusers/pipelines/pipeline_utils.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * fix
    
    * fix variant
    
    * change saving logic
    
    * DDUF - Load transformers components manually (#10171)
    
    * update hfh version
    
    * Load transformers components manually
    
    * load encoder from_pretrained with state_dict
    
    * working version with transformers and tokenizer !
    
    * add generation_config case
    
    * fix tests
    
    * remove saving for now
    
    * typing
    
    * need next version from transformers
    
    * Update src/diffusers/configuration_utils.py
    Co-authored-by: default avatarLucain <lucain@huggingface.co>
    
    * check path corectly
    
    * Apply suggestions from code review
    Co-authored-by: default avatarLucain <lucain@huggingface.co>
    
    * udapte
    
    * typing
    
    * remove check for subfolder
    
    * quality
    
    * revert setup changes
    
    * oups
    
    * more readable condition
    
    * add loading from the hub test
    
    * add basic docs.
    
    * Apply suggestions from code review
    Co-authored-by: default avatarLucain <lucain@huggingface.co>
    
    * add example
    
    * add
    
    * make functions private
    
    * Apply suggestions from code review
    Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
    
    * minor.
    
    * fixes
    
    * fix
    
    * change the precdence of parameterized.
    
    * error out when custom pipeline is passed with dduf_file.
    
    * updates
    
    * fix
    
    * updates
    
    * fixes
    
    * updates
    
    * fix xfail condition.
    
    * fix xfail
    
    * fixes
    
    * sharded checkpoint compat
    
    * add test for sharded checkpoint
    
    * add suggestions
    
    * Update src/diffusers/models/model_loading_utils.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * from suggestions
    
    * add class attributes to flag dduf tests
    
    * last one
    
    * fix logic
    
    * remove comment
    
    * revert changes
    
    ---------
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    Co-authored-by: default avatarLucain <lucain@huggingface.co>
    Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    fbff43ac
test_blipdiffusion.py 6.31 KB