"vscode:/vscode.git/clone" did not exist on "85fc4559722138416c477b08bc3e8e0e07fce5af"
text_generation.mdx 1.59 KB
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
<!--Copyright 2022 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
specific language governing permissions and limitations under the License.
-->

# Generation

15
Each framework has a generate method for auto-regressive text generation implemented in their respective `GenerationMixin` class:
16

17
18
19
- PyTorch [`~generation.GenerationMixin.generate`] is implemented in [`~generation.GenerationMixin`].
- TensorFlow [`~generation.TFGenerationMixin.generate`] is implemented in [`~generation.TFGenerationMixin`].
- Flax/JAX [`~generation.FlaxGenerationMixin.generate`] is implemented in [`~generation.FlaxGenerationMixin`].
20

21
22
23
24
25
26
27
28
<!--- TODO: add a brief description of GenerationConfig (with examples) when it becomes usable with generate --->

## GenerationConfig

[[autodoc]] generation.GenerationConfig
	- from_pretrained
	- save_pretrained

29
## GenerationMixin
30

31
[[autodoc]] generation.GenerationMixin
32
33
34
35
36
	- generate
	- greedy_search
	- sample
	- beam_search
	- beam_sample
37
	- contrastive_search
38
39
40
	- group_beam_search
	- constrained_beam_search

41
## TFGenerationMixin
42

43
[[autodoc]] generation.TFGenerationMixin
44
45
	- generate

46
## FlaxGenerationMixin
47

48
[[autodoc]] generation.FlaxGenerationMixin
49
	- generate