pipelines.rst 3.36 KB
Newer Older
Lysandre Debut's avatar
Lysandre Debut committed
1
2
3
4
5
Pipelines
----------------------------------------------------

The pipelines are a great and easy way to use models for inference. These pipelines are objects that abstract most
of the complex code from the library, offering a simple API dedicated to several tasks, including Named Entity
Sylvain Gugger's avatar
Sylvain Gugger committed
6
7
Recognition, Masked Language Modeling, Sentiment Analysis, Feature Extraction and Question Answering. See the
:doc:`task summary <../task_summary>` for examples of use.
Lysandre Debut's avatar
Lysandre Debut committed
8
9
10

There are two categories of pipeline abstractions to be aware about:

Sylvain Gugger's avatar
Sylvain Gugger committed
11
12
13
14
15
16
17
18
19
20
21
22
- The :func:`~transformers.pipeline` which is the most powerful object encapsulating all other pipelines.
- The other task-specific pipelines:

    - :class:`~transformers.ConversationalPipeline`
    - :class:`~transformers.FeatureExtractionPipeline`
    - :class:`~transformers.FillMaskPipeline`
    - :class:`~transformers.QuestionAnsweringPipeline`
    - :class:`~transformers.SummarizationPipeline`
    - :class:`~transformers.TextClassificationPipeline`
    - :class:`~transformers.TextGenerationPipeline`
    - :class:`~transformers.TokenClassificationPipeline`
    - :class:`~transformers.TranslationPipeline`
23
    - :class:`~transformers.ZeroShotClassificationPipeline`
Lysandre Debut's avatar
Lysandre Debut committed
24
25
26
27
28
29
30

The pipeline abstraction
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The `pipeline` abstraction is a wrapper around all the other available pipelines. It is instantiated as any
other pipeline but requires an additional argument which is the `task`.

Sylvain Gugger's avatar
Sylvain Gugger committed
31
.. autofunction:: transformers.pipeline
Lysandre Debut's avatar
Lysandre Debut committed
32
33
34


The task specific pipelines
Sylvain Gugger's avatar
Sylvain Gugger committed
35
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lysandre Debut's avatar
Lysandre Debut committed
36

Sylvain Gugger's avatar
Sylvain Gugger committed
37
ConversationalPipeline
Lysandre Debut's avatar
Lysandre Debut committed
38
39
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
40
.. autoclass:: transformers.Conversation
Lysandre Debut's avatar
Lysandre Debut committed
41

Sylvain Gugger's avatar
Sylvain Gugger committed
42
43
44
45
46
.. autoclass:: transformers.ConversationalPipeline
    :special-members: __call__
    :members:

FeatureExtractionPipeline
Lysandre Debut's avatar
Lysandre Debut committed
47
48
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
49
50
51
.. autoclass:: transformers.FeatureExtractionPipeline
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
52
53
54
55
56

FillMaskPipeline
==========================================

.. autoclass:: transformers.FillMaskPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
57
58
    :special-members: __call__
    :members:
Lysandre Debut's avatar
Lysandre Debut committed
59

Sylvain Gugger's avatar
Sylvain Gugger committed
60
NerPipeline
Lysandre Debut's avatar
Lysandre Debut committed
61
62
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
63
64
This class is an alias of the :class:`~transformers.TokenClassificationPipeline` defined below. Please refer to that
pipeline for documentation and usage examples.
Lysandre Debut's avatar
Lysandre Debut committed
65
66
67
68
69

QuestionAnsweringPipeline
==========================================

.. autoclass:: transformers.QuestionAnsweringPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
70
71
    :special-members: __call__
    :members:
72
73
74
75
76

SummarizationPipeline
==========================================

.. autoclass:: transformers.SummarizationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
77
78
    :special-members: __call__
    :members:
79

Sylvain Gugger's avatar
Sylvain Gugger committed
80
81
82
83
84
85
TextClassificationPipeline
==========================================

.. autoclass:: transformers.TextClassificationPipeline
    :special-members: __call__
    :members:
86
87
88
89
90

TextGenerationPipeline
==========================================

.. autoclass:: transformers.TextGenerationPipeline
Sylvain Gugger's avatar
Sylvain Gugger committed
91
92
    :special-members: __call__
    :members:
93

Sylvain Gugger's avatar
Sylvain Gugger committed
94
TokenClassificationPipeline
95
96
==========================================

Sylvain Gugger's avatar
Sylvain Gugger committed
97
98
99
100
.. autoclass:: transformers.TokenClassificationPipeline
    :special-members: __call__
    :members:

101
102
103
104
105
106
107
ZeroShotClassificationPipeline
==========================================

.. autoclass:: transformers.ZeroShotClassificationPipeline
    :special-members: __call__
    :members:

108

Sylvain Gugger's avatar
Sylvain Gugger committed
109
110
111
112
113
Parent class: :obj:`Pipeline`
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: transformers.Pipeline
    :members: