text_generation.mdx 2.02 KB
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
<!--Copyright 2022 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
specific language governing permissions and limitations under the License.
-->

# Generation

15
Each framework has a generate method for text generation implemented in their respective `GenerationMixin` class:
16

17
18
19
- PyTorch [`~generation.GenerationMixin.generate`] is implemented in [`~generation.GenerationMixin`].
- TensorFlow [`~generation.TFGenerationMixin.generate`] is implemented in [`~generation.TFGenerationMixin`].
- Flax/JAX [`~generation.FlaxGenerationMixin.generate`] is implemented in [`~generation.FlaxGenerationMixin`].
20

21
22
23
24
Regardless of your framework of choice, you can parameterize the generate method with a [`~generation.GenerationConfig`]
class instance. Please refer to this class for the complete list of generation parameters, which control the behavior
of the generation method.

25
26
27
To learn how to inspect a model's generation configuration, what are the defaults, how to change the parameters ad hoc,
and how to create and save a customized generation configuration, refer to the
[text generation strategies guide](./generation_strategies).
28
29
30
31
32

## GenerationConfig

[[autodoc]] generation.GenerationConfig
	- from_pretrained
33
	- from_model_config
34
35
	- save_pretrained

36
## GenerationMixin
37

38
[[autodoc]] generation.GenerationMixin
39
	- generate
40
	- compute_transition_scores
41
42
43
44
	- greedy_search
	- sample
	- beam_search
	- beam_sample
45
	- contrastive_search
46
47
48
	- group_beam_search
	- constrained_beam_search

49
## TFGenerationMixin
50

51
[[autodoc]] generation.TFGenerationMixin
52
53
	- generate

54
## FlaxGenerationMixin
55

56
[[autodoc]] generation.FlaxGenerationMixin
57
	- generate