models.rst 3.28 KB
Newer Older
Tomás Osório's avatar
Tomás Osório committed
1
2
3
4
.. role:: hidden
    :class: hidden-section

torchaudio.models
moto's avatar
moto committed
5
=================
Tomás Osório's avatar
Tomás Osório committed
6

moto's avatar
moto committed
7
8
.. py:module:: torchaudio.models

Tomás Osório's avatar
Tomás Osório committed
9
10
11
12
.. currentmodule:: torchaudio.models

The models subpackage contains definitions of models for addressing common audio tasks.

13
14
15
16
17
18
Conformer
~~~~~~~~~

.. autoclass:: Conformer

  .. automethod:: forward
Tomás Osório's avatar
Tomás Osório committed
19

moto's avatar
moto committed
20
21
ConvTasNet
~~~~~~~~~~
moto's avatar
moto committed
22

23
24
25
26
27
28
Model
-----

ConvTasNet
^^^^^^^^^^

moto's avatar
moto committed
29
30
31
32
.. autoclass:: ConvTasNet

  .. automethod:: forward

33
34
35
36
37
38
39
Factory Functions
-----------------

conv_tasnet_base
^^^^^^^^^^^^^^^^

.. autofunction:: conv_tasnet_base
moto's avatar
moto committed
40

moto's avatar
moto committed
41
42
DeepSpeech
~~~~~~~~~~
discort's avatar
discort committed
43
44
45
46
47

.. autoclass:: DeepSpeech

  .. automethod:: forward

48
49
50
51
52
53
54
55
56
Emformer
~~~~~~~~

.. autoclass:: Emformer

  .. automethod:: forward

  .. automethod:: infer

57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
Hybrid Demucs
~~~~~~~~~~~~~

Model
-----

HDemucs
^^^^^^^

.. autoclass:: HDemucs

  .. automethod:: forward

Factory Functions
-----------------

hdemucs_low
^^^^^^^^^^^

.. autofunction:: hdemucs_low

hdemucs_medium
^^^^^^^^^^^^^^

.. autofunction:: hdemucs_medium

hdemucs_high
^^^^^^^^^^^^

.. autofunction:: hdemucs_high

88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
RNN-T
~~~~~

Model
-----

RNNT
^^^^

.. autoclass:: RNNT

  .. automethod:: forward

  .. automethod:: transcribe_streaming

  .. automethod:: transcribe

  .. automethod:: predict

  .. automethod:: join

Factory Functions
-----------------

emformer_rnnt_model
^^^^^^^^^^^^^^^^^^^

.. autofunction:: emformer_rnnt_model

emformer_rnnt_base
^^^^^^^^^^^^^^^^^^

.. autofunction:: emformer_rnnt_base


Decoder
-------

RNNTBeamSearch
^^^^^^^^^^^^^^

.. autoclass:: RNNTBeamSearch

  .. automethod:: forward

  .. automethod:: infer

Hypothesis
^^^^^^^^^^

138
.. container:: py attribute
139

140
141
  .. autodata::  Hypothesis
    :no-value:
discort's avatar
discort committed
142

143
144
145
146
147
148
149
150
151
Tacotron2
~~~~~~~~~

.. autoclass:: Tacotron2

  .. automethod:: forward

  .. automethod:: infer

moto's avatar
moto committed
152
153
Wav2Letter
~~~~~~~~~~
Tomás Osório's avatar
Tomás Osório committed
154
155
156
157

.. autoclass:: Wav2Letter

  .. automethod:: forward
jimchen90's avatar
jimchen90 committed
158
159


moto's avatar
moto committed
160
161
Wav2Vec2.0 / HuBERT
~~~~~~~~~~~~~~~~~~~
moto's avatar
moto committed
162

moto's avatar
moto committed
163
164
165
Model
-----

moto's avatar
moto committed
166
Wav2Vec2Model
moto's avatar
moto committed
167
^^^^^^^^^^^^^
moto's avatar
moto committed
168
169
170
171
172
173
174

.. autoclass:: Wav2Vec2Model

  .. automethod:: extract_features

  .. automethod:: forward

175
176
177
178
179
180
181
HuBERTPretrainModel
^^^^^^^^^^^^^^^^^^^

.. autoclass:: HuBERTPretrainModel

  .. automethod:: forward

moto's avatar
moto committed
182
183
184
Factory Functions
-----------------

185
186
187
188
189
190
wav2vec2_model
^^^^^^^^^^^^^^

.. autofunction:: wav2vec2_model


moto's avatar
moto committed
191
wav2vec2_base
moto's avatar
moto committed
192
^^^^^^^^^^^^^
moto's avatar
moto committed
193

moto's avatar
moto committed
194
195
.. autofunction:: wav2vec2_base

moto's avatar
moto committed
196
wav2vec2_large
moto's avatar
moto committed
197
^^^^^^^^^^^^^^
moto's avatar
moto committed
198

moto's avatar
moto committed
199
200
.. autofunction:: wav2vec2_large

moto's avatar
moto committed
201
wav2vec2_large_lv60k
moto's avatar
moto committed
202
^^^^^^^^^^^^^^^^^^^^
moto's avatar
moto committed
203

moto's avatar
moto committed
204
205
.. autofunction:: wav2vec2_large_lv60k

moto's avatar
moto committed
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
hubert_base
^^^^^^^^^^^

.. autofunction:: hubert_base

hubert_large
^^^^^^^^^^^^

.. autofunction:: hubert_large

hubert_xlarge
^^^^^^^^^^^^^

.. autofunction:: hubert_xlarge

221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
hubert_pretrain_model
^^^^^^^^^^^^^^^^^^^^^

.. autofunction:: hubert_pretrain_model

hubert_pretrain_base
^^^^^^^^^^^^^^^^^^^^

.. autofunction:: hubert_pretrain_base

hubert_pretrain_large
^^^^^^^^^^^^^^^^^^^^^

.. autofunction:: hubert_pretrain_large

hubert_pretrain_xlarge
^^^^^^^^^^^^^^^^^^^^^^

.. autofunction:: hubert_pretrain_xlarge

241
242
243
Utility Functions
-----------------

244
245
.. currentmodule:: torchaudio.models.wav2vec2.utils

moto's avatar
moto committed
246
import_huggingface_model
moto's avatar
moto committed
247
^^^^^^^^^^^^^^^^^^^^^^^^
moto's avatar
moto committed
248

249
250
.. autofunction:: import_huggingface_model

moto's avatar
moto committed
251
import_fairseq_model
moto's avatar
moto committed
252
^^^^^^^^^^^^^^^^^^^^
moto's avatar
moto committed
253

moto's avatar
moto committed
254
255
.. autofunction:: import_fairseq_model

256
.. currentmodule:: torchaudio.models
moto's avatar
moto committed
257

moto's avatar
moto committed
258
259
WaveRNN
~~~~~~~
jimchen90's avatar
jimchen90 committed
260
261
262
263

.. autoclass:: WaveRNN

  .. automethod:: forward
moto's avatar
moto committed
264

265
  .. automethod:: infer