pipelines.rst 6.13 KB
Newer Older
Sylvain Gugger's avatar
Sylvain Gugger committed
1
2
3
4
5
6
7
8
9
10
11
12
.. 
    Copyright 2020 The HuggingFace Team. All rights reserved.

    Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
    the License. You may obtain a copy of the License at

        http://www.apache.org/licenses/LICENSE-2.0

    Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
    an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
    specific language governing permissions and limitations under the License.

Lysandre Debut's avatar
Lysandre Debut committed
13
Pipelines
Sylvain Gugger's avatar
Sylvain Gugger committed
14
-----------------------------------------------------------------------------------------------------------------------
Lysandre Debut's avatar
Lysandre Debut committed
15

Sylvain Gugger's avatar
Sylvain Gugger committed
16
17
The pipelines are a great and easy way to use models for inference. These pipelines are objects that abstract most of
the complex code from the library, offering a simple API dedicated to several tasks, including Named Entity
Sylvain Gugger's avatar
Sylvain Gugger committed
18
19
Recognition, Masked Language Modeling, Sentiment Analysis, Feature Extraction and Question Answering. See the
:doc:`task summary <../task_summary>` for examples of use.
Lysandre Debut's avatar
Lysandre Debut committed
20
21
22

There are two categories of pipeline abstractions to be aware about:

Sylvain Gugger's avatar
Sylvain Gugger committed
23
24
25
- The :func:`~transformers.pipeline` which is the most powerful object encapsulating all other pipelines.
- The other task-specific pipelines:

26
    - :class:`~transformers.AutomaticSpeechRecognitionPipeline`
Sylvain Gugger's avatar
Sylvain Gugger committed
27
28
29
30
31
32
33
34
35
    - :class:`~transformers.ConversationalPipeline`
    - :class:`~transformers.FeatureExtractionPipeline`
    - :class:`~transformers.FillMaskPipeline`
    - :class:`~transformers.QuestionAnsweringPipeline`
    - :class:`~transformers.SummarizationPipeline`
    - :class:`~transformers.TextClassificationPipeline`
    - :class:`~transformers.TextGenerationPipeline`
    - :class:`~transformers.TokenClassificationPipeline`
    - :class:`~transformers.TranslationPipeline`
36
    - :class:`~transformers.ZeroShotClassificationPipeline`
37
    - :class:`~transformers.Text2TextGenerationPipeline`
38
    - :class:`~transformers.TableQuestionAnsweringPipeline`
Lysandre Debut's avatar
Lysandre Debut committed
39
40

The pipeline abstraction
Sylvain Gugger's avatar
Sylvain Gugger committed
41
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lysandre Debut's avatar
Lysandre Debut committed
42

Sylvain Gugger's avatar
Sylvain Gugger committed
43
44
The `pipeline` abstraction is a wrapper around all the other available pipelines. It is instantiated as any other
pipeline but requires an additional argument which is the `task`.
Lysandre Debut's avatar
Lysandre Debut committed
45

Sylvain Gugger's avatar
Sylvain Gugger committed
46
.. autofunction:: transformers.pipeline
Lysandre Debut's avatar
Lysandre Debut committed
47
48
49


The task specific pipelines
Sylvain Gugger's avatar
Sylvain Gugger committed
50
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lysandre Debut's avatar
Lysandre Debut committed
51

52
53
54
55
56
57
58
AutomaticSpeechRecognitionPipeline
=======================================================================================================================

.. autoclass:: transformers.AutomaticSpeechRecognitionPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
59
ConversationalPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
60
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
61

Sylvain Gugger's avatar
Sylvain Gugger committed
62
.. autoclass:: transformers.Conversation
Lysandre Debut's avatar
Lysandre Debut committed
63

Sylvain Gugger's avatar
Sylvain Gugger committed
64
65
66
67
68
.. autoclass:: transformers.ConversationalPipeline
    :special-members: __call__
    :members:

FeatureExtractionPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
69
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
70

Sylvain Gugger's avatar
Sylvain Gugger committed
71
72
73
.. autoclass:: transformers.FeatureExtractionPipeline
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
74
75

FillMaskPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
76
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
77
78

.. autoclass:: transformers.FillMaskPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
79
80
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
81

Sylvain Gugger's avatar
Sylvain Gugger committed
82
NerPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
83
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
84

85
86
87
.. autoclass:: transformers.NerPipeline

See :class:`~transformers.TokenClassificationPipeline` for all details.
Lysandre Debut's avatar
Lysandre Debut committed
88
89

QuestionAnsweringPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
90
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
91
92

.. autoclass:: transformers.QuestionAnsweringPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
93
94
    :special-members: __call__
    :members:
95
96

SummarizationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
97
=======================================================================================================================
98
99

.. autoclass:: transformers.SummarizationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
100
101
    :special-members: __call__
    :members:
102

103
104
105
106
107
108
109
TableQuestionAnsweringPipeline
=======================================================================================================================

.. autoclass:: transformers.TableQuestionAnsweringPipeline
    :special-members: __call__


Sylvain Gugger's avatar
Sylvain Gugger committed
110
TextClassificationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
111
=======================================================================================================================
Sylvain Gugger's avatar
Sylvain Gugger committed
112
113
114
115

.. autoclass:: transformers.TextClassificationPipeline
    :special-members: __call__
    :members:
116
117

TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
118
=======================================================================================================================
119
120

.. autoclass:: transformers.TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
121
122
    :special-members: __call__
    :members:
123

124
Text2TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
125
=======================================================================================================================
126
127
128
129
130

.. autoclass:: transformers.Text2TextGenerationPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
131
TokenClassificationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
132
=======================================================================================================================
133

Sylvain Gugger's avatar
Sylvain Gugger committed
134
135
136
137
.. autoclass:: transformers.TokenClassificationPipeline
    :special-members: __call__
    :members:

138
139
140
141
142
143
144
TranslationPipeline
=======================================================================================================================

.. autoclass:: transformers.TranslationPipeline
    :special-members: __call__
    :members:

145
ZeroShotClassificationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
146
=======================================================================================================================
147
148
149
150
151

.. autoclass:: transformers.ZeroShotClassificationPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
152
Parent class: :obj:`Pipeline`
Sylvain Gugger's avatar
Sylvain Gugger committed
153
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Sylvain Gugger's avatar
Sylvain Gugger committed
154
155
156

.. autoclass:: transformers.Pipeline
    :members: