• Rafie Walker's avatar
    Implement SD3 loss weighting (#8528) · 6946facf
    Rafie Walker authored
    
    
    * Add lognorm and cosmap weighting
    
    * Implement mode sampling
    
    * Update examples/dreambooth/train_dreambooth_lora_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_lora_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_lora_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_sd3.py
    
    * Update examples/dreambooth/train_dreambooth_lora_sd3.py
    
    * keep timestamp sampling fully on cpu
    
    ---------
    Co-authored-by: default avatarKashif Rasul <kashif.rasul@gmail.com>
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    6946facf
train_dreambooth_sd3.py 70.3 KB