README.md 1.67 KB
Newer Older
Anton Lozhkov's avatar
Anton Lozhkov committed
1
2
## Training examples

3
4
Creating a training image set is [described in a different document](https://huggingface.co/docs/datasets/image_process#image-datasets).

anton-l's avatar
anton-l committed
5
6
7
8
9
10
11
12
### Installing the dependencies

Before running the scipts, make sure to install the library's training dependencies:

```bash
pip install diffusers[training] accelerate datasets
```

anton-l's avatar
anton-l committed
13
### Unconditional Flowers  
Anton Lozhkov's avatar
Anton Lozhkov committed
14
15
16
17

The command to train a DDPM UNet model on the Oxford Flowers dataset:

```bash
18
accelerate launch train_unconditional.py \
Anton Lozhkov's avatar
Anton Lozhkov committed
19
20
  --dataset="huggan/flowers-102-categories" \
  --resolution=64 \
21
22
  --output_dir="ddpm-ema-flowers-64" \
  --train_batch_size=16 \
Anton Lozhkov's avatar
Anton Lozhkov committed
23
24
  --num_epochs=100 \
  --gradient_accumulation_steps=1 \
25
26
27
28
  --learning_rate=1e-4 \
  --lr_warmup_steps=500 \
  --mixed_precision=no \
  --push_to_hub
Anton Lozhkov's avatar
Anton Lozhkov committed
29
```
Anton Lozhkov's avatar
Anton Lozhkov committed
30
An example trained model: https://huggingface.co/anton-l/ddpm-ema-flowers-64
Anton Lozhkov's avatar
Anton Lozhkov committed
31

anton-l's avatar
anton-l committed
32
A full training run takes 2 hours on 4xV100 GPUs.
Anton Lozhkov's avatar
Anton Lozhkov committed
33

Anton Lozhkov's avatar
Anton Lozhkov committed
34
<img src="https://user-images.githubusercontent.com/26864830/180248660-a0b143d0-b89a-42c5-8656-2ebf6ece7e52.png" width="700" />
Anton Lozhkov's avatar
Anton Lozhkov committed
35
36


anton-l's avatar
anton-l committed
37
### Unconditional Pokemon 
Anton Lozhkov's avatar
Anton Lozhkov committed
38
39
40
41

The command to train a DDPM UNet model on the Pokemon dataset:

```bash
42
accelerate launch train_unconditional.py \
Anton Lozhkov's avatar
Anton Lozhkov committed
43
44
  --dataset="huggan/pokemon" \
  --resolution=64 \
45
46
  --output_dir="ddpm-ema-pokemon-64" \
  --train_batch_size=16 \
Anton Lozhkov's avatar
Anton Lozhkov committed
47
48
  --num_epochs=100 \
  --gradient_accumulation_steps=1 \
49
50
51
52
  --learning_rate=1e-4 \
  --lr_warmup_steps=500 \
  --mixed_precision=no \
  --push_to_hub
Anton Lozhkov's avatar
Anton Lozhkov committed
53
```
Anton Lozhkov's avatar
Anton Lozhkov committed
54
An example trained model: https://huggingface.co/anton-l/ddpm-ema-pokemon-64
Anton Lozhkov's avatar
Anton Lozhkov committed
55

anton-l's avatar
anton-l committed
56
A full training run takes 2 hours on 4xV100 GPUs.
Anton Lozhkov's avatar
Anton Lozhkov committed
57

Anton Lozhkov's avatar
Anton Lozhkov committed
58
<img src="https://user-images.githubusercontent.com/26864830/180248200-928953b4-db38-48db-b0c6-8b740fe6786f.png" width="700" />