pipelines.rst 3.59 KB
Newer Older
Lysandre Debut's avatar
Lysandre Debut committed
1
2
3
4
5
Pipelines
----------------------------------------------------

The pipelines are a great and easy way to use models for inference. These pipelines are objects that abstract most
of the complex code from the library, offering a simple API dedicated to several tasks, including Named Entity
Sylvain Gugger's avatar
Sylvain Gugger committed
6
7
Recognition, Masked Language Modeling, Sentiment Analysis, Feature Extraction and Question Answering. See the
:doc:`task summary <../task_summary>` for examples of use.
Lysandre Debut's avatar
Lysandre Debut committed
8
9
10

There are two categories of pipeline abstractions to be aware about:

Sylvain Gugger's avatar
Sylvain Gugger committed
11
12
13
14
15
16
17
18
19
20
21
22
- The :func:`~transformers.pipeline` which is the most powerful object encapsulating all other pipelines.
- The other task-specific pipelines:

    - :class:`~transformers.ConversationalPipeline`
    - :class:`~transformers.FeatureExtractionPipeline`
    - :class:`~transformers.FillMaskPipeline`
    - :class:`~transformers.QuestionAnsweringPipeline`
    - :class:`~transformers.SummarizationPipeline`
    - :class:`~transformers.TextClassificationPipeline`
    - :class:`~transformers.TextGenerationPipeline`
    - :class:`~transformers.TokenClassificationPipeline`
    - :class:`~transformers.TranslationPipeline`
23
    - :class:`~transformers.ZeroShotClassificationPipeline`
24
    - :class:`~transformers.Text2TextGenerationPipeline`
Lysandre Debut's avatar
Lysandre Debut committed
25
26
27
28
29
30
31

The pipeline abstraction
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The `pipeline` abstraction is a wrapper around all the other available pipelines. It is instantiated as any
other pipeline but requires an additional argument which is the `task`.

Sylvain Gugger's avatar
Sylvain Gugger committed
32
.. autofunction:: transformers.pipeline
Lysandre Debut's avatar
Lysandre Debut committed
33
34
35


The task specific pipelines
Sylvain Gugger's avatar
Sylvain Gugger committed
36
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lysandre Debut's avatar
Lysandre Debut committed
37

Sylvain Gugger's avatar
Sylvain Gugger committed
38
ConversationalPipeline
Lysandre Debut's avatar
Lysandre Debut committed
39
40
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
41
.. autoclass:: transformers.Conversation
Lysandre Debut's avatar
Lysandre Debut committed
42

Sylvain Gugger's avatar
Sylvain Gugger committed
43
44
45
46
47
.. autoclass:: transformers.ConversationalPipeline
    :special-members: __call__
    :members:

FeatureExtractionPipeline
Lysandre Debut's avatar
Lysandre Debut committed
48
49
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
50
51
52
.. autoclass:: transformers.FeatureExtractionPipeline
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
53
54
55
56
57

FillMaskPipeline
==========================================

.. autoclass:: transformers.FillMaskPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
58
59
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
60

Sylvain Gugger's avatar
Sylvain Gugger committed
61
NerPipeline
Lysandre Debut's avatar
Lysandre Debut committed
62
63
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
64
65
This class is an alias of the :class:`~transformers.TokenClassificationPipeline` defined below. Please refer to that
pipeline for documentation and usage examples.
Lysandre Debut's avatar
Lysandre Debut committed
66
67
68
69
70

QuestionAnsweringPipeline
==========================================

.. autoclass:: transformers.QuestionAnsweringPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
71
72
    :special-members: __call__
    :members:
73
74
75
76
77

SummarizationPipeline
==========================================

.. autoclass:: transformers.SummarizationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
78
79
    :special-members: __call__
    :members:
80

Sylvain Gugger's avatar
Sylvain Gugger committed
81
82
83
84
85
86
TextClassificationPipeline
==========================================

.. autoclass:: transformers.TextClassificationPipeline
    :special-members: __call__
    :members:
87
88
89
90
91

TextGenerationPipeline
==========================================

.. autoclass:: transformers.TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
92
93
    :special-members: __call__
    :members:
94

95
96
97
98
99
100
101
Text2TextGenerationPipeline
==========================================

.. autoclass:: transformers.Text2TextGenerationPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
102
TokenClassificationPipeline
103
104
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
105
106
107
108
.. autoclass:: transformers.TokenClassificationPipeline
    :special-members: __call__
    :members:

109
110
111
112
113
114
115
ZeroShotClassificationPipeline
==========================================

.. autoclass:: transformers.ZeroShotClassificationPipeline
    :special-members: __call__
    :members:

Sylvain Gugger's avatar
Sylvain Gugger committed
116
117
118
119
120
Parent class: :obj:`Pipeline`
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: transformers.Pipeline
    :members: