pipelines.rst 2.27 KB
Newer Older
Lysandre Debut's avatar
Lysandre Debut committed
1
2
3
4
5
6
7
8
9
10
Pipelines
----------------------------------------------------

The pipelines are a great and easy way to use models for inference. These pipelines are objects that abstract most
of the complex code from the library, offering a simple API dedicated to several tasks, including Named Entity
Recognition, Masked Language Modeling, Sentiment Analysis, Feature Extraction and Question Answering.

There are two categories of pipeline abstractions to be aware about:

- The :class:`~transformers.pipeline` which is the most powerful object encapsulating all other pipelines
11
- The other task-specific pipelines, such as :class:`~transformers.TokenClassificationPipeline`
Lysandre Debut's avatar
Lysandre Debut committed
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
  or :class:`~transformers.QuestionAnsweringPipeline`

The pipeline abstraction
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The `pipeline` abstraction is a wrapper around all the other available pipelines. It is instantiated as any
other pipeline but requires an additional argument which is the `task`.

.. autoclass:: transformers.pipeline
    :members:


The task specific pipelines
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Parent class: Pipeline
=========================================

.. autoclass:: transformers.Pipeline
    :members: predict, transform, save_pretrained

33
TokenClassificationPipeline
Lysandre Debut's avatar
Lysandre Debut committed
34
35
==========================================

36
.. autoclass:: transformers.TokenClassificationPipeline
Lysandre Debut's avatar
Lysandre Debut committed
37

38
NerPipeline
Lysandre Debut's avatar
Lysandre Debut committed
39
40
==========================================

41
This class is an alias of the :class:`~transformers.TokenClassificationPipeline` defined above. Please refer to that pipeline for
Lysandre Debut's avatar
Lysandre Debut committed
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
documentation and usage examples.

FillMaskPipeline
==========================================

.. autoclass:: transformers.FillMaskPipeline

FeatureExtractionPipeline
==========================================

.. autoclass:: transformers.FeatureExtractionPipeline

TextClassificationPipeline
==========================================

.. autoclass:: transformers.TextClassificationPipeline

QuestionAnsweringPipeline
==========================================

.. autoclass:: transformers.QuestionAnsweringPipeline

64
65
66
67
68

SummarizationPipeline
==========================================

.. autoclass:: transformers.SummarizationPipeline
69
70
71
72
73
74


TextGenerationPipeline
==========================================

.. autoclass:: transformers.TextGenerationPipeline