- 03 Feb, 2024 1 commit
-
-
Linoy Tsaban authored
* add noise_offset param * micro conditioning - wip * image processing adjusted and moved to support micro conditioning * change time ids to be computed inside train loop * change time ids to be computed inside train loop * change time ids to be computed inside train loop * time ids shape fix * move token replacement of validation prompt to the same section of instance prompt and class prompt * add offset noise to sd15 advanced script * fix token loading during validation * fix token loading during validation in sdxl script * a little clean * style * a little clean * style * sdxl script - a little clean + minor path fix sd 1.5 script - change default resolution value * ad 1.5 script - minor path fix * fix missing comma in code example in model card * clean up commented lines * style * remove time ids computed outside training loop - no longer used now that we utilize micro-conditioning, as all time ids are now computed inside the training loop * style * [WIP] - added draft readme, building off of examples/dreambooth/README.md * readme * readme * readme * readme * readme * readme * readme * readme * removed --crops_coords_top_left from CLI args * style * fix missing shape bug due to missing RGB if statement * add blog mention at the start of the reamde as well * Update examples/advanced_diffusion_training/README.md Co-authored-by:
Sayak Paul <spsayakpaul@gmail.com> * change note to render nicely as well --------- Co-authored-by:
-
- 24 Jan, 2024 1 commit
-
-
Brandon Strong authored
* sd1.5 support in separate script A quick adaptation to support people interested in using this method on 1.5 models. * sd15 prompt text encoding and unet conversions as per @linoytsaban 's recommendations. Testing would be appreciated, * Readability and quality improvements Removed some mentions of SDXL, and some arguments that don't apply to sd 1.5, and cleaned up some comments. * make style/quality commands * tracker rename and run-it doc * Update examples/advanced_diffusion_training/train_dreambooth_lora_sd15_advanced.py * Update examples/advanced_diffusion_training/train_dreambooth_lora_sd15_advanced.py --------- Co-authored-by:Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>
-
- 17 Jan, 2024 2 commits
-
-
Linoy Tsaban authored
* fixes bugs: 1. redundant retraction 2. param clone 3. stopping optimization of text encoder params * param upscaling * style
-
Steve Rhoades authored
resolve conflicts
-
- 16 Jan, 2024 1 commit
-
-
Steve Rhoades authored
* Fixes #6418 Advanced Dreambooth LoRa Training * change order of import to fix nit * fix nit, use cast_training_params * remove torch.compile fix, will move to a new PR * remove unnecessary import
-
- 05 Jan, 2024 2 commits
-
-
Sayak Paul authored
* post release * style --------- Co-authored-by:Patrick von Platen <patrick.v.platen@gmail.com>
-
Linoy Tsaban authored
* unwrap text encoder when saving hook only for full text encoder tuning * unwrap text encoder when saving hook only for full text encoder tuning * save embeddings in each checkpoint as well * save embeddings in each checkpoint as well * save embeddings in each checkpoint as well * Update examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py Co-authored-by:
-
- 02 Jan, 2024 1 commit
-
-
Linoy Tsaban authored
[bug fix] using snr gamma and prior preservation loss in the dreambooth lora sdxl training scripts (#6356) * change timesteps used to calculate snr when --with_prior_preservation is enabled * change timesteps used to calculate snr when --with_prior_preservation is enabled (canonical script) * style * revert canonical script to before snr gamma change --------- Co-authored-by:
-
- 30 Dec, 2023 1 commit
-
-
apolinário authored
* Add WebUI format support to Advanced Training Script * style --------- Co-authored-by:multimodalart <joaopaulo.passos+multimodal@gmail.com>
-
- 27 Dec, 2023 2 commits
-
-
apolinário authored
fix keys for lora format on advanced training scripts
-
apolinário authored
* Fix ProdigyOPT in SDXL Dreambooth script * style * style * Add PEFT to Advanced Training Script * style * style *
✨ style✨ * change order for logic operation * add lora alpha * style * Align PEFT to new format * Update train_dreambooth_lora_sdxl_advanced.py Apply #6355 fix --------- Co-authored-by:
-
- 26 Dec, 2023 1 commit
-
-
Sayak Paul authored
* add: script to train lcm lora for sdxl with
🤗 datasets * suit up the args. * remove comments. * fix num_update_steps * fix batch unmarshalling * fix num_update_steps_per_epoch * fix; dataloading. * fix microconditions. * unconditional predictions debug * fix batch size. * no need to use use_auth_token * Apply suggestions from code review Co-authored-by:Suraj Patil <surajp815@gmail.com> * make vae encoding batch size an arg * final serialization in kohya * style * state dict rejigging * feat: no separate teacher unet. * debug * fix state dict serialization * debug * debug * debug * remove prints. * remove kohya utility and make style * fix serialization * fix * add test * add peft dependency. * add: peft * remove peft * autocast device determination from accelerator * autocast * reduce lora rank. * remove unneeded space * Apply suggestions from code review Co-authored-by:
Younes Belkada <49240599+younesbelkada@users.noreply.github.com> * style * make log validation leaner. * move back enabled in. * fix: log_validation call. * add: checkpointing tests * taking my chances to see if disabling autocasting has any effect? * start debugging * name * name * name * more debug * more debug * index * remove index. * print length * print length * print length * move unet.train() after add_adapter() * disable some prints. * enable_adapters() manually. * remove prints. * some changes. * fix params_to_optimize * more fixes * debug * debug * remove print * disable grad for certain contexts. * Add support for IPAdapterFull (#5911) * Add support for IPAdapterFull Co-authored-by:
YiYi Xu <yixu310@gmail.com> Co-authored-by:
yiyixuxu <yixu310@gmail,com> * [Advanced Diffusion Script] Add Widget default text (#6100) add widget * [Advanced Training Script] Fix pipe example (#6106) * IP-Adapter for StableDiffusionControlNetImg2ImgPipeline (#5901) * adapter for StableDiffusionControlNetImg2ImgPipeline * fix-copies * fix-copies --------- Co-authored-by:
dg845 <dgu8957@gmail.com> * [Peft] fix saving / loading when unet is not "unet" (#6046) * [Peft] fix saving / loading when unet is not "unet" * Update src/diffusers/loaders/lora.py Co-authored-by:
Fabio Rigano <57982783+fabiorigano@users.noreply.github.com> Co-authored-by:
apolinário <joaopaulo.passos@gmail.com> Co-authored-by:
Charchit Sharma <charchitsharma11@gmail.com> Co-authored-by:
Aryan V S <contact.aryanvs@gmail.com> Co-authored-by:
Kashif Rasul <kashif.rasul@gmail.com>
-
- 14 Dec, 2023 1 commit
-
-
Linoy Tsaban authored
[advanced dreambooth lora sdxl training script] load pipeline for inference only if validation prompt is used (#6171) * load pipeline for inference only if validation prompt is used * move things outside * load pipeline for inference only if validation prompt is used * fix readme when validation prompt is used --------- Co-authored-by:
linoytsaban <linoy@huggingface.co> Co-authored-by:
-
- 08 Dec, 2023 2 commits
-
-
apolinário authored
-
apolinário authored
add widget
-
- 06 Dec, 2023 1 commit
-
-
apolinário authored
* add cache latents * style
-
- 05 Dec, 2023 1 commit
-
-
apolinário authored
* Update train_dreambooth_lora_sdxl_advanced.py * remove global function args from dreamboothdataset class * style * style --------- Co-authored-by:
-
- 04 Dec, 2023 3 commits
-
-
Linoy Tsaban authored
* improve help tags * style fix * changes token_abstraction type to string. support multiple concepts for pivotal using a comma separated string. * style fixup * changed logger to warning (not yet available) * moved the token_abstraction parsing to be in the same block as where we create the mapping of identifier to token --------- Co-authored-by: -
Levi McCallum authored
Co-authored-by: -
Linoy Tsaban authored
* improve help tags * style fix --------- Co-authored-by:
-
- 01 Dec, 2023 3 commits
-
-
Patrick von Platen authored
* Post Release: v0.24.0 * post pone deprecation * post pone deprecation * Add model_index.json
-
Linoy Tsaban authored
readme
-
Linoy Tsaban authored
[examples/advanced_diffusion_training] bug fixes and improvements for LoRA Dreambooth SDXL advanced training script (#5935) * imports and readme bug fixes * bug fix - ensures text_encoder params are dtype==float32 (when using pivotal tuning) even if the rest of the model is loaded in fp16 * added pivotal tuning to readme * mapping token identifier to new inserted token in validation prompt (if used) * correct default value of --train_text_encoder_frac * change default value of --adam_weight_decay_text_encoder * validation prompt generations when using pivotal tuning bug fix * style fix * textual inversion embeddings name change * style fix * bug fix - stopping text encoder optimization halfway * readme - will include token abstraction and new inserted tokens when using pivotal tuning - added type to --num_new_tokens_per_abstraction * style fix --------- Co-authored-by:
-
- 22 Nov, 2023 1 commit
-
-
Linoy Tsaban authored
Adds an advanced version of the SD-XL DreamBooth LoRA training script supporting pivotal tuning (#5883) * sdxl dreambooth lora training script with pivotal tuning * bug fix - args missing from parse_args * code quality fixes * comment unnecessary code from TokenEmbedding handler class * fixup --------- Co-authored-by:
-
