1. 12 Aug, 2024 1 commit
    • Linoy Tsaban's avatar
      [Flux Dreambooth LoRA] - te bug fixes & updates (#9139) · 413ca29b
      Linoy Tsaban authored
      * add requirements + fix link to bghira's guide
      
      * text ecnoder training fixes
      
      * text encoder training fixes
      
      * text encoder training fixes
      
      * text encoder training fixes
      
      * style
      
      * add tests
      
      * fix encode_prompt call
      
      * style
      
      * unpack_latents test
      
      * fix lora saving
      
      * remove default val for max_sequenece_length in encode_prompt
      
      * remove default val for max_sequenece_length in encode_prompt
      
      * style
      
      * testing
      
      * style
      
      * testing
      
      * testing
      
      * style
      
      * fix sizing issue
      
      * style
      
      * revert scaling
      
      * style
      
      * style
      
      * scaling test
      
      * style
      
      * scaling test
      
      * remove model pred operation left from pre-conditioning
      
      * remove model pred operation left from pre-conditioning
      
      * fix trainable params
      
      * remove te2 from casting
      
      * transformer to accelerator
      
      * remove prints
      
      * empty commit
      413ca29b
  2. 09 Aug, 2024 1 commit
    • Linoy Tsaban's avatar
      [Flux] Dreambooth LoRA training scripts (#9086) · 65e30907
      Linoy Tsaban authored
      
      
      * initial commit - dreambooth for flux
      
      * update transformer to be FluxTransformer2DModel
      
      * update training loop and validation inference
      
      * fix sd3->flux docs
      
      * add guidance handling, not sure if it makes sense(?)
      
      * inital dreambooth lora commit
      
      * fix text_ids in compute_text_embeddings
      
      * fix imports of static methods
      
      * fix pipeline loading in readme, remove auto1111 docs for now
      
      * fix pipeline loading in readme, remove auto1111 docs for now, remove some irrelevant text_encoder_3 refs
      
      * Update examples/dreambooth/train_dreambooth_flux.py
      Co-authored-by: default avatarBagheera <59658056+bghira@users.noreply.github.com>
      
      * fix te2 loading and remove te2 refs from text encoder training
      
      * fix tokenizer_2 initialization
      
      * remove text_encoder training refs from lora script (for now)
      
      * try with vae in bfloat16, fix model hook save
      
      * fix tokenization
      
      * fix static imports
      
      * fix CLIP import
      
      * remove text_encoder training refs (for now) from lora script
      
      * fix minor bug in encode_prompt, add guidance def in lora script, ...
      
      * fix unpack_latents args
      
      * fix license in readme
      
      * add "none" to weighting_scheme options for uniform sampling
      
      * style
      
      * adapt model saving - remove text encoder refs
      
      * adapt model loading - remove text encoder refs
      
      * initial commit for readme
      
      * Update examples/dreambooth/train_dreambooth_lora_flux.py
      Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
      
      * Update examples/dreambooth/train_dreambooth_lora_flux.py
      Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
      
      * fix vae casting
      
      * remove precondition_outputs
      
      * readme
      
      * readme
      
      * style
      
      * readme
      
      * readme
      
      * update weighting scheme default & docs
      
      * style
      
      * add text_encoder training to lora script, change vae_scale_factor value in both
      
      * style
      
      * text encoder training fixes
      
      * style
      
      * update readme
      
      * minor fixes
      
      * fix te params
      
      * fix te params
      
      ---------
      Co-authored-by: default avatarBagheera <59658056+bghira@users.noreply.github.com>
      Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
      65e30907
  3. 03 Aug, 2024 1 commit
  4. 21 Jul, 2024 1 commit
  5. 25 Jun, 2024 1 commit
  6. 24 Jun, 2024 1 commit
  7. 19 Jun, 2024 1 commit
  8. 17 Jun, 2024 1 commit
  9. 12 Jun, 2024 2 commits