Skip to content

GitLab

Switch branch/tag
  1. 02 Jun, 2023 3 commits
    • Kashif Rasul's avatar
      fixed typo in example train_text_to_image.py (#3608) · f1d47433
      Kashif Rasul authored 
      fixed typo
      f1d47433
    • Takuma Mori's avatar
      Support Kohya-ss style LoRA file format (in a limited capacity) (#3437) · 8e552bb4
      Takuma Mori authored 
      

* add _convert_kohya_lora_to_diffusers

* make style

* add scaffold

* match result: unet attention only

* fix monkey-patch for text_encoder

* with CLIPAttention

While the terrible images are no longer produced,
the results do not match those from the hook ver.
This may be due to not setting the network_alpha value.

* add to support network_alpha

* generate diff image

* fix monkey-patch for text_encoder

* add test_text_encoder_lora_monkey_patch()

* verify that it's okay to release the attn_procs

* fix closure version

* add comment

* Revert "fix monkey-patch for text_encoder"

This reverts commit bb9c61e6faecc1935c9c4319c77065837655d616.

* Fix to reuse utility functions

* make LoRAAttnProcessor targets to self_attn

* fix LoRAAttnProcessor target

* make style

* fix split key

* Update src/diffusers/loaders.py

* remove TEXT_ENCODER_TARGET_MODULES loop

* add print memory usage

* remove test_kohya_loras_scaffold.py

* add: doc on LoRA civitai

* remove print statement and refactor in the doc.

* fix state_dict test for kohya-ss style lora

* Apply suggestions from code review
Co-authored-by: default avatarTakuma Mori <takuma104@gmail.com>

---------
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
      8e552bb4
    • Sayak Paul's avatar
      [Docs] include the instruction-tuning blog link in the InstructPix2Pix docs (#3644) · 55dbfa02
      Sayak Paul authored 
      include the instruction-tuning blog link.
      55dbfa02
  3. 31 May, 2023 3 commits
  5. 30 May, 2023 6 commits
  7. 26 May, 2023 1 commit
  9. 24 May, 2023 1 commit
  11. 23 May, 2023 2 commits
  13. 22 May, 2023 4 commits
  15. 19 May, 2023 1 commit
  17. 17 May, 2023 4 commits
  19. 16 May, 2023 1 commit
  21. 12 May, 2023 1 commit
  23. 11 May, 2023 2 commits
  25. 09 May, 2023 1 commit
    • Will Berman's avatar
      if dreambooth lora (#3360) · a757b2db
      Will Berman authored 
      * update IF stage I pipelines

add fixed variance schedulers and lora loading

* added kv lora attn processor

* allow loading into alternative lora attn processor

* make vae optional

* throw away predicted variance

* allow loading into added kv lora layer

* allow load T5

* allow pre compute text embeddings

* set new variance type in schedulers

* fix copies

* refactor all prompt embedding code

class prompts are now included in pre-encoding code
max tokenizer length is now configurable
embedding attention mask is now configurable

* fix for when variance type is not defined on scheduler

* do not pre compute validation prompt if not present

* add example test for if lora dreambooth

* add check for train text encoder and pre compute text embeddings
      a757b2db
  27. 06 May, 2023 2 commits
  29. 04 May, 2023 1 commit
  31. 03 May, 2023 2 commits
  33. 28 Apr, 2023 4 commits
  35. 27 Apr, 2023 1 commit