Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "eeeb52f464cea18ef41b9108b3823aa91ebce31a"
Switch branch/tag
  1. 15 Jun, 2023 1 commit
  3. 08 Jun, 2023 2 commits
  5. 22 May, 2023 1 commit
  7. 27 Apr, 2023 1 commit
  9. 26 Apr, 2023 3 commits
  11. 19 Apr, 2023 1 commit
    • Will Berman's avatar
      controlnet training resize inputs to multiple of 8 (#3135) · 7e6886f5
      Will Berman authored 
      controlnet training center crop input images to multiple of 8

The pipeline code resizes inputs to multiples of 8.
Not doing this resizing in the training script is causing
the encoded image to have different height/width dimensions
than the encoded conditioning image (which uses a separate
encoder that's part of the controlnet model).

We resize and center crop the inputs to make sure they're the
same size (as well as all other images in the batch). We also
check that the initial resolution is a multiple of 8.
      7e6886f5
  13. 18 Apr, 2023 3 commits
  15. 12 Apr, 2023 4 commits
    • Andreas Steiner's avatar
      Adds profiling flags, computes train metrics average. (#3053) · d06e0694
      Andreas Steiner authored 
      * WIP controlnet training

- bugfix --streaming
- bugfix running report_to!='wandb'
- adds memory profile before validation

* Adds final logging statement.

* Sets train epochs to 11.

Looking at a longer ~16ep run, we see only good validation images
after ~11ep:

https://wandb.ai/andsteing/controlnet_fill50k/runs/3j2hx6n8



* Removes --logging_dir (it's not used).

* Adds --profile flags.

* Updates --output_dir=runs/fill-circle-{timestamp}.

* Compute mean of `train_metrics`.

Previously `train_metrics[-1]` was logged, resulting in very bumpy train
metrics.

* Improves logging a bit.

- adds l2_grads gradient norm logging
- adds steps_per_sec
- sets walltime as x coordinate of train/step
- logs controlnet_params config

* Adds --ccache (doesn't really help though).

* minor fix in controlnet flax example (#2986)

* fix the error when push_to_hub but not log validation

* contronet_from_pt & controlnet_revision

* add intermediate checkpointing to the guide

* Bugfix --profile_steps

* Sets `RACKER_PROJECT_NAME='controlnet_fill50k'`.

* Logs fractional epoch.

* Adds relative `walltime` metric.

* Adds `StepTraceAnnotation` and uses `global_step` insetad of `step`.

* Applied `black`.

* Streamlines commands in README a bit.

* Removes `--ccache`.

This makes only a very small difference (~1 min) with this model size, so removing
the option introduced in cdb3cc.

* Re-ran `black`.

* Update examples/controlnet/README.md
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>

* Converts spaces to tab.

* Removes repeated args.

* Skips first step (compilation) in profiling

* Updates README with profiling instructions.

* Unifies tabs/spaces in README.

* Re-ran style & quality.

---------
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
      d06e0694
    • Patrick von Platen's avatar
      [Post release] v0.16.0dev (#3072) · 0a73b4d3
      Patrick von Platen authored
      0a73b4d3
    • Patrick von Platen's avatar
      Release: v0.15.0 · e7534542
      Patrick von Platen authored
      e7534542
    • Sayak Paul's avatar
      [Examples] Fix type-casting issue in the ControlNet training script (#2994) · e607a582
      Sayak Paul authored 
      * fix: norm group test for UNet3D.

* fix: type-casting issue in controlnet training.
      e607a582
  17. 11 Apr, 2023 2 commits
  19. 10 Apr, 2023 1 commit
  21. 06 Apr, 2023 1 commit
  23. 05 Apr, 2023 1 commit
  25. 04 Apr, 2023 4 commits
  27. 30 Mar, 2023 1 commit
  29. 29 Mar, 2023 1 commit
  31. 28 Mar, 2023 1 commit
  33. 15 Mar, 2023 1 commit