kandinsky_v22.md 3.27 KB
Newer Older
1
2
3
4
5
6
7
8
9
10
11
<!--Copyright 2023 The HuggingFace Team. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
specific language governing permissions and limitations under the License.
-->

# Kandinsky 2.2

12
Kandinsky 2.2 is created by [Arseniy Shakhmatov](https://github.com/cene555), [Anton Razzhigaev](https://github.com/razzant), [Aleksandr Nikolich](https://github.com/AlexWortega), [Vladimir Arkhipkin](https://github.com/oriBetelgeuse), [Igor Pavlov](https://github.com/boomb0om), [Andrey Kuznetsov](https://github.com/kuznetsoffandrey), and [Denis Dimitrov](https://github.com/denndimitrov).
13

Steven Liu's avatar
Steven Liu committed
14
The description from it's GitHub page is:
YiYi Xu's avatar
YiYi Xu committed
15

Steven Liu's avatar
Steven Liu committed
16
*Kandinsky 2.2 brings substantial improvements upon its predecessor, Kandinsky 2.1, by introducing a new, more powerful image encoder - CLIP-ViT-G and the ControlNet support. The switch to CLIP-ViT-G as the image encoder significantly increases the model's capability to generate more aesthetic pictures and better understand text, thus enhancing the model's overall performance. The addition of the ControlNet mechanism allows the model to effectively control the process of generating images. This leads to more accurate and visually appealing outputs and opens new possibilities for text-guided image manipulation.*
YiYi Xu's avatar
YiYi Xu committed
17

Steven Liu's avatar
Steven Liu committed
18
The original codebase can be found at [ai-forever/Kandinsky-2](https://github.com/ai-forever/Kandinsky-2).
19
20
21

<Tip>

Steven Liu's avatar
Steven Liu committed
22
Check out the [Kandinsky Community](https://huggingface.co/kandinsky-community) organization on the Hub for the official model checkpoints for tasks like text-to-image, image-to-image, and inpainting.
23
24
25

</Tip>

26
27
28
29
30
31
<Tip>

Make sure to check out the schedulers [guide](../../using-diffusers/schedulers) to learn how to explore the tradeoff between scheduler speed and quality, and see the [reuse components across pipelines](../../using-diffusers/loading#reuse-components-across-pipelines) section to learn how to efficiently load the same components into multiple pipelines.

</Tip>

Steven Liu's avatar
Steven Liu committed
32
## KandinskyV22PriorPipeline
33

Steven Liu's avatar
Steven Liu committed
34
[[autodoc]] KandinskyV22PriorPipeline
35
36
	- all
	- __call__
Steven Liu's avatar
Steven Liu committed
37
	- interpolate
38

Steven Liu's avatar
Steven Liu committed
39
## KandinskyV22Pipeline
40

Steven Liu's avatar
Steven Liu committed
41
[[autodoc]] KandinskyV22Pipeline
42
43
44
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
45
## KandinskyV22CombinedPipeline
46

Steven Liu's avatar
Steven Liu committed
47
[[autodoc]] KandinskyV22CombinedPipeline
48
49
50
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
51
## KandinskyV22ControlnetPipeline
52

Steven Liu's avatar
Steven Liu committed
53
[[autodoc]] KandinskyV22ControlnetPipeline
54
55
56
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
57
## KandinskyV22PriorEmb2EmbPipeline
58

Steven Liu's avatar
Steven Liu committed
59
[[autodoc]] KandinskyV22PriorEmb2EmbPipeline
60
61
	- all
	- __call__
Steven Liu's avatar
Steven Liu committed
62
	- interpolate
63

Steven Liu's avatar
Steven Liu committed
64
## KandinskyV22Img2ImgPipeline
65

Steven Liu's avatar
Steven Liu committed
66
[[autodoc]] KandinskyV22Img2ImgPipeline
67
68
69
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
70
## KandinskyV22Img2ImgCombinedPipeline
71

Steven Liu's avatar
Steven Liu committed
72
[[autodoc]] KandinskyV22Img2ImgCombinedPipeline
73
74
75
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
76
## KandinskyV22ControlnetImg2ImgPipeline
77

Steven Liu's avatar
Steven Liu committed
78
[[autodoc]] KandinskyV22ControlnetImg2ImgPipeline
79
80
81
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
82
## KandinskyV22InpaintPipeline
83

Steven Liu's avatar
Steven Liu committed
84
[[autodoc]] KandinskyV22InpaintPipeline
85
86
87
	- all
	- __call__

Steven Liu's avatar
Steven Liu committed
88
## KandinskyV22InpaintCombinedPipeline
89
90
91
92

[[autodoc]] KandinskyV22InpaintCombinedPipeline
	- all
	- __call__