• Linoy Tsaban's avatar
    [HiDream LoRA] optimizations + small updates (#11381) · edd78804
    Linoy Tsaban authored
    
    
    * 1. add pre-computation of prompt embeddings when custom prompts are used as well
    2. save model card even if model is not pushed to hub
    3. remove scheduler initialization from code example - not necessary anymore (it's now if the base model's config)
    4. add skip_final_inference - to allow to run with validation, but skip the final loading of the pipeline with the lora weights to reduce memory reqs
    
    * pre encode validation prompt as well
    
    * Update examples/dreambooth/train_dreambooth_lora_hidream.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * Update examples/dreambooth/train_dreambooth_lora_hidream.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * Update examples/dreambooth/train_dreambooth_lora_hidream.py
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    
    * pre encode validation prompt as well
    
    * Apply style fixes
    
    * empty commit
    
    * change default trained modules
    
    * empty commit
    
    * address comments + change encoding of validation prompt (before it was only pre-encoded if custom prompts are provided, but should be pre-encoded either way)
    
    * Apply style fixes
    
    * empty commit
    
    * fix validation_embeddings definition
    
    * fix final inference condition
    
    * fix pipeline deletion in last inference
    
    * Apply style fixes
    
    * empty commit
    
    * layers
    
    * remove readme remarks on only pre-computing when instance prompt is provided and change example to 3d icons
    
    * smol fix
    
    * empty commit
    
    ---------
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    Co-authored-by: default avatargithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
    edd78804
README_hidream.md 4.79 KB