pipelines.rst 5.81 KB
Newer Older
Sylvain Gugger's avatar
Sylvain Gugger committed
1
2
3
4
5
6
7
8
9
10
11
12
.. 
    Copyright 2020 The HuggingFace Team. All rights reserved.

    Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
    the License. You may obtain a copy of the License at

        http://www.apache.org/licenses/LICENSE-2.0

    Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
    an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
    specific language governing permissions and limitations under the License.

Lysandre Debut's avatar
Lysandre Debut committed
13
Pipelines
Sylvain Gugger's avatar
Sylvain Gugger committed
14
-----------------------------------------------------------------------------------------------------------------------
Lysandre Debut's avatar
Lysandre Debut committed
15

Sylvain Gugger's avatar
Sylvain Gugger committed
16
17
The pipelines are a great and easy way to use models for inference. These pipelines are objects that abstract most of
the complex code from the library, offering a simple API dedicated to several tasks, including Named Entity
Sylvain Gugger's avatar
Sylvain Gugger committed
18
19
Recognition, Masked Language Modeling, Sentiment Analysis, Feature Extraction and Question Answering. See the
:doc:`task summary <../task_summary>` for examples of use.
Lysandre Debut's avatar
Lysandre Debut committed
20
21
22

There are two categories of pipeline abstractions to be aware about:

Sylvain Gugger's avatar
Sylvain Gugger committed
23
24
25
26
27
28
29
30
31
32
33
34
- The :func:`~transformers.pipeline` which is the most powerful object encapsulating all other pipelines.
- The other task-specific pipelines:

    - :class:`~transformers.ConversationalPipeline`
    - :class:`~transformers.FeatureExtractionPipeline`
    - :class:`~transformers.FillMaskPipeline`
    - :class:`~transformers.QuestionAnsweringPipeline`
    - :class:`~transformers.SummarizationPipeline`
    - :class:`~transformers.TextClassificationPipeline`
    - :class:`~transformers.TextGenerationPipeline`
    - :class:`~transformers.TokenClassificationPipeline`
    - :class:`~transformers.TranslationPipeline`
35
    - :class:`~transformers.ZeroShotClassificationPipeline`
36
    - :class:`~transformers.Text2TextGenerationPipeline`
37
    - :class:`~transformers.TableQuestionAnsweringPipeline`
Lysandre Debut's avatar
Lysandre Debut committed
38
39

The pipeline abstraction
Sylvain Gugger's avatar
Sylvain Gugger committed
40
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lysandre Debut's avatar
Lysandre Debut committed
41

Sylvain Gugger's avatar
Sylvain Gugger committed
42
43
The `pipeline` abstraction is a wrapper around all the other available pipelines. It is instantiated as any other
pipeline but requires an additional argument which is the `task`.
Lysandre Debut's avatar
Lysandre Debut committed
44

Sylvain Gugger's avatar
Sylvain Gugger committed
45
.. autofunction:: transformers.pipeline
Lysandre Debut's avatar
Lysandre Debut committed
46
47
48


The task specific pipelines
Sylvain Gugger's avatar
Sylvain Gugger committed
49
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lysandre Debut's avatar
Lysandre Debut committed
50

Sylvain Gugger's avatar
Sylvain Gugger committed
51
ConversationalPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
52
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
53

Sylvain Gugger's avatar
Sylvain Gugger committed
54
.. autoclass:: transformers.Conversation
Lysandre Debut's avatar
Lysandre Debut committed
55

Sylvain Gugger's avatar
Sylvain Gugger committed
56
57
58
59
60
.. autoclass:: transformers.ConversationalPipeline
    :special-members: __call__
    :members:

FeatureExtractionPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
61
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
62

Sylvain Gugger's avatar
Sylvain Gugger committed
63
64
65
.. autoclass:: transformers.FeatureExtractionPipeline
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
66
67

FillMaskPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
68
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
69
70

.. autoclass:: transformers.FillMaskPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
71
72
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
73

Sylvain Gugger's avatar
Sylvain Gugger committed
74
NerPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
75
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
76

77
78
79
.. autoclass:: transformers.NerPipeline

See :class:`~transformers.TokenClassificationPipeline` for all details.
Lysandre Debut's avatar
Lysandre Debut committed
80
81

QuestionAnsweringPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
82
=======================================================================================================================
Lysandre Debut's avatar
Lysandre Debut committed
83
84

.. autoclass:: transformers.QuestionAnsweringPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
85
86
    :special-members: __call__
    :members:
87
88

SummarizationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
89
=======================================================================================================================
90
91

.. autoclass:: transformers.SummarizationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
92
93
    :special-members: __call__
    :members:
94

95
96
97
98
99
100
101
TableQuestionAnsweringPipeline
=======================================================================================================================

.. autoclass:: transformers.TableQuestionAnsweringPipeline
    :special-members: __call__


Sylvain Gugger's avatar
Sylvain Gugger committed
102
TextClassificationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
103
=======================================================================================================================
Sylvain Gugger's avatar
Sylvain Gugger committed
104
105
106
107

.. autoclass:: transformers.TextClassificationPipeline
    :special-members: __call__
    :members:
108
109

TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
110
=======================================================================================================================
111
112

.. autoclass:: transformers.TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
113
114
    :special-members: __call__
    :members:
115

116
Text2TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
117
=======================================================================================================================
118
119
120
121
122

.. autoclass:: transformers.Text2TextGenerationPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
123
TokenClassificationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
124
=======================================================================================================================
125

Sylvain Gugger's avatar
Sylvain Gugger committed
126
127
128
129
.. autoclass:: transformers.TokenClassificationPipeline
    :special-members: __call__
    :members:

130
131
132
133
134
135
136
TranslationPipeline
=======================================================================================================================

.. autoclass:: transformers.TranslationPipeline
    :special-members: __call__
    :members:

137
ZeroShotClassificationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
138
=======================================================================================================================
139
140
141
142
143

.. autoclass:: transformers.ZeroShotClassificationPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
144
Parent class: :obj:`Pipeline`
Sylvain Gugger's avatar
Sylvain Gugger committed
145
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Sylvain Gugger's avatar
Sylvain Gugger committed
146
147
148

.. autoclass:: transformers.Pipeline
    :members: