kandinsky.md 2.67 KB
Newer Older
YiYi Xu's avatar
YiYi Xu committed
1
2
3
4
5
6
7
8
9
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
specific language governing permissions and limitations under the License.
-->

Steven Liu's avatar
Steven Liu committed
10
# Kandinsky 2.1
YiYi Xu's avatar
YiYi Xu committed
11

12
Kandinsky 2.1 is created by [Arseniy Shakhmatov](https://github.com/cene555), [Anton Razzhigaev](https://github.com/razzant), [Aleksandr Nikolich](https://github.com/AlexWortega), [Vladimir Arkhipkin](https://github.com/oriBetelgeuse), [Igor Pavlov](https://github.com/boomb0om), [Andrey Kuznetsov](https://github.com/kuznetsoffandrey), and [Denis Dimitrov](https://github.com/denndimitrov).
YiYi Xu's avatar
YiYi Xu committed
13

Steven Liu's avatar
Steven Liu committed
14
The description from it's GitHub page is:
YiYi Xu's avatar
YiYi Xu committed
15

Steven Liu's avatar
Steven Liu committed
16
*Kandinsky 2.1 inherits best practicies from Dall-E 2 and Latent diffusion, while introducing some new ideas. As text and image encoder it uses CLIP model and diffusion image prior (mapping) between latent spaces of CLIP modalities. This approach increases the visual performance of the model and unveils new horizons in blending images and text-guided image manipulation.*
YiYi Xu's avatar
YiYi Xu committed
17

Steven Liu's avatar
Steven Liu committed
18
The original codebase can be found at [ai-forever/Kandinsky-2](https://github.com/ai-forever/Kandinsky-2).
19

20
21
<Tip>

Steven Liu's avatar
Steven Liu committed
22
Check out the [Kandinsky Community](https://huggingface.co/kandinsky-community) organization on the Hub for the official model checkpoints for tasks like text-to-image, image-to-image, and inpainting.
23
24
25

</Tip>

26
27
28
29
30
31
<Tip>

Make sure to check out the Schedulers [guide](../../using-diffusers/schedulers) to learn how to explore the tradeoff between scheduler speed and quality, and see the [reuse components across pipelines](../../using-diffusers/loading#reuse-components-across-pipelines) section to learn how to efficiently load the same components into multiple pipelines.

</Tip>

Steven Liu's avatar
Steven Liu committed
32
## KandinskyPriorPipeline
YiYi Xu's avatar
YiYi Xu committed
33

34
[[autodoc]] KandinskyPriorPipeline
YiYi Xu's avatar
YiYi Xu committed
35
36
	- all
	- __call__
37
	- interpolate
38

Steven Liu's avatar
Steven Liu committed
39
## KandinskyPipeline
40

41
[[autodoc]] KandinskyPipeline
YiYi Xu's avatar
YiYi Xu committed
42
43
44
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
45
## KandinskyCombinedPipeline
YiYi Xu's avatar
YiYi Xu committed
46

Steven Liu's avatar
Steven Liu committed
47
[[autodoc]] KandinskyCombinedPipeline
YiYi Xu's avatar
YiYi Xu committed
48
49
50
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
51
## KandinskyImg2ImgPipeline
YiYi Xu's avatar
YiYi Xu committed
52

Steven Liu's avatar
Steven Liu committed
53
[[autodoc]] KandinskyImg2ImgPipeline
YiYi Xu's avatar
YiYi Xu committed
54
55
	- all
	- __call__
56

Steven Liu's avatar
Steven Liu committed
57
## KandinskyImg2ImgCombinedPipeline
YiYi Xu's avatar
YiYi Xu committed
58

Steven Liu's avatar
Steven Liu committed
59
[[autodoc]] KandinskyImg2ImgCombinedPipeline
YiYi Xu's avatar
YiYi Xu committed
60
61
62
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
63
## KandinskyInpaintPipeline
YiYi Xu's avatar
YiYi Xu committed
64

Steven Liu's avatar
Steven Liu committed
65
[[autodoc]] KandinskyInpaintPipeline
YiYi Xu's avatar
YiYi Xu committed
66
67
68
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
69
## KandinskyInpaintCombinedPipeline
70

71
[[autodoc]] KandinskyInpaintCombinedPipeline
72
73
	- all
	- __call__