Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
contents.rst 31.2 KB
Newer Older
yuguo-Jack's avatar
llama_paddle  
yuguo-Jack committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203 


------------------------------------
T5模型汇总
------------------------------------



下表汇总介绍了目前PaddleNLP支持的T5模型对应预训练权重。
关于模型的具体细节可以参考对应链接。

+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
| Pretrained Weight                                                                | Language     | Details of the model                                                             |
+==================================================================================+==============+==================================================================================+
|``t5-small``                                                                      | English      | 6-layer, 512-hidden,                                                             |
|                                                                                  |              | 8-heads, 93M parameters.                                                         |
|                                                                                  |              | T5 small model.                                                                  |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``t5-base``                                                                       | English      | 12-layer, 768-hidden,                                                            |
|                                                                                  |              | 12-heads, 272M parameters.                                                       |
|                                                                                  |              | T5 base model.                                                                   |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``t5-large``                                                                      | English      | 24-layer, 1024-hidden,                                                           |
|                                                                                  |              | 16-heads, 803M parameters.                                                       |
|                                                                                  |              | T5 large model.                                                                  |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``t5-v1_1-base``                                                                  | English      | Please refer to:                                                                 |                                    
|                                                                                  |              | t5-v1_1-base_                                                                    |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``t5-v1_1-large``                                                                 | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | t5-v1_1-large_                                                                   |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``Langboat/mengzi-t5-base``                                                       | Chinese      | Please refer to:                                                                 |                                   
|                                                                                  |              | `Langboat/mengzi-t5-base`_                                                       |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``Langboat/mengzi-t5-base-mt``                                                    | Chinese      | Please refer to:                                                                 |                                   
|                                                                                  |              | `Langboat/mengzi-t5-base-mt`_                                                    |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``deep-learning-analytics/wikihow-t5-small``                                      | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `deep-learning-analytics/wikihow-t5-small`_                                      |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``sberbank-ai/ruT5-base``                                                         | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `sberbank-ai/ruT5-base`_                                                         |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``Michau/t5-base-en-generate-headline``                                           | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `Michau/t5-base-en-generate-headline`_                                           |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``google/t5-v1_1-small``                                                          | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `google/t5-v1_1-small`_                                                          |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``prithivida/parrot_paraphraser_on_T5``                                           | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `prithivida/parrot_paraphraser_on_T5`_                                           |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``prithivida/grammar_error_correcter_v1``                                         | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `prithivida/grammar_error_correcter_v1`_                                         |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``valhalla/t5-small-qg-hl``                                                       | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `valhalla/t5-small-qg-hl`_                                                       |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``valhalla/t5-small-qa-qg-hl``                                                    | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `valhalla/t5-small-qa-qg-hl`_                                                    |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``ramsrigouthamg/t5-large-paraphraser-diverse-high-quality``                      | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `ramsrigouthamg/t5-large-paraphraser-diverse-high-quality`_                      |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``mrm8488/t5-base-finetuned-common_gen``                                          | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `mrm8488/t5-base-finetuned-common_gen`_                                          |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``valhalla/t5-small-e2e-qg``                                                      | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `valhalla/t5-small-e2e-qg`_                                                      |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``sonoisa/t5-base-japanese``                                                      | japanese     | Please refer to:                                                                 |                                   
|                                                                                  |              | `sonoisa/t5-base-japanese`_                                                      |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``google/t5-base-lm-adapt``                                                       | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `google/t5-base-lm-adapt`_                                                       |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``google/t5-small-lm-adapt``                                                      | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `google/t5-small-lm-adapt`_                                                      |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``valhalla/t5-small-qg-prepend``                                                  | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `valhalla/t5-small-qg-prepend`_                                                  |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``prithivida/informal_to_formal_styletransfer``                                   | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `prithivida/informal_to_formal_styletransfer`_                                   |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``KETI-AIR/ke-t5-base``                                                           | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `KETI-AIR/ke-t5-base`_                                                           |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``nielsr/nt5-small-rc1``                                                          | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `nielsr/nt5-small-rc1`_                                                          |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``snrspeaks/t5-one-line-summary``                                                 | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `snrspeaks/t5-one-line-summary`_                                                 |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``mrm8488/t5-small-finetuned-quora-for-paraphrasing``                             | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `mrm8488/t5-small-finetuned-quora-for-paraphrasing`_                             |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``p-christ/12412fsasf``                                                           | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `p-christ/12412fsasf`_                                                           |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``tscholak/3vnuv1vf``                                                             | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `tscholak/3vnuv1vf`_                                                             |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``tennessejoyce/titlewave-t5-base``                                               | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `tennessejoyce/titlewave-t5-base`_                                               |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``vennify/t5-base-grammar-correction``                                            | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `vennify/t5-base-grammar-correction`_                                            |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``megagonlabs/t5-base-japanese-web``                                              | Japanese     | Please refer to:                                                                 |                                   
|                                                                                  |              | `megagonlabs/t5-base-japanese-web`_                                              |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``sberbank-ai/ruT5-large``                                                        | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `sberbank-ai/ruT5-large`_                                                        |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``tscholak/t5.1.1.lm100k.base``                                                   | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `tscholak/t5.1.1.lm100k.base`_                                                   |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``deep-learning-analytics/GrammarCorrector``                                      | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `deep-learning-analytics/GrammarCorrector`_                                      |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``ThomasNLG/t5-qa_squad2neg-en``                                                  | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `ThomasNLG/t5-qa_squad2neg-en`_                                                  |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``flexudy/t5-small-wav2vec2-grammar-fixer``                                       | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `flexudy/t5-small-wav2vec2-grammar-fixer`_                                       |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``KETI-AIR/ke-t5-small``                                                          | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `KETI-AIR/ke-t5-small`_                                                          |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``razent/SciFive-large-Pubmed_PMC``                                               | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `razent/SciFive-large-Pubmed_PMC`_                                               |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``google/t5-large-ssm-nq``                                                        | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `google/t5-large-ssm-nq`_                                                        |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``ozcangundes/T5-base-for-BioQA``                                                 | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `ozcangundes/T5-base-for-BioQA`_                                                 |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``Rostlab/prot_t5_base_mt_uniref50``                                              | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `Rostlab/prot_t5_base_mt_uniref50`_                                              |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``sonoisa/t5-base-japanese-question-generation``                                  | Japanese     | Please refer to:                                                                 |                                   
|                                                                                  |              | `sonoisa/t5-base-japanese-question-generation`_                                  |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``Wikidepia/IndoT5-base``                                                         | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `Wikidepia/IndoT5-base`_                                                         |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``razent/SciFive-base-Pubmed_PMC``                                                | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `razent/SciFive-base-Pubmed_PMC`_                                                |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+
|``google/t5-small-ssm-nq``                                                        | English      | Please refer to:                                                                 |                                   
|                                                                                  |              | `google/t5-small-ssm-nq`_                                                        |
+----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+



.. _t5-v1_1-base: https://huggingface.co/google/t5-v1_1-base
.. _t5-v1_1-large: https://huggingface.co/google/t5-v1_1-large
.. _Langboat/mengzi-t5-base: https://huggingface.co/Langboat/mengzi-t5-base
.. _Langboat/mengzi-t5-base-mt: https://huggingface.co/Langboat/mengzi-t5-base-mt
.. _deep-learning-analytics/wikihow-t5-small: https://huggingface.co/deep-learning-analytics/wikihow-t5-small
.. _sberbank-ai/ruT5-base: https://huggingface.co/sberbank-ai/ruT5-base
.. _Michau/t5-base-en-generate-headline: https://huggingface.co/Michau/t5-base-en-generate-headline
.. _google/t5-v1_1-small: https://huggingface.co/google/t5-v1_1-small
.. _prithivida/parrot_paraphraser_on_T5: https://huggingface.co/prithivida/parrot_paraphraser_on_T5
.. _prithivida/grammar_error_correcter_v1: https://huggingface.co/prithivida/grammar_error_correcter_v1
.. _valhalla/t5-small-qg-hl: https://huggingface.co/valhalla/t5-small-qg-hl
.. _valhalla/t5-small-qa-qg-hl: https://huggingface.co/valhalla/t5-small-qa-qg-hl
.. _ramsrigouthamg/t5-large-paraphraser-diverse-high-quality: https://huggingface.co/ramsrigouthamg/t5-large-paraphraser-diverse-high-quality
.. _mrm8488/t5-base-finetuned-common_gen: https://huggingface.co/mrm8488/t5-base-finetuned-common_gen
.. _valhalla/t5-small-e2e-qg: https://huggingface.co/valhalla/t5-small-e2e-qg
.. _sonoisa/t5-base-japanese: https://huggingface.co/sonoisa/t5-base-japanese
.. _google/t5-base-lm-adapt: https://huggingface.co/google/t5-base-lm-adapt
.. _google/t5-small-lm-adapt: https://huggingface.co/google/t5-small-lm-adapt
.. _valhalla/t5-small-qg-prepend: https://huggingface.co/valhalla/t5-small-qg-prepend
.. _prithivida/informal_to_formal_styletransfer: https://huggingface.co/prithivida/informal_to_formal_styletransfer
.. _KETI-AIR/ke-t5-base: https://huggingface.co/KETI-AIR/ke-t5-base
.. _nielsr/nt5-small-rc1: https://huggingface.co/nielsr/nt5-small-rc1
.. _snrspeaks/t5-one-line-summary: https://huggingface.co/snrspeaks/t5-one-line-summary
.. _mrm8488/t5-small-finetuned-quora-for-paraphrasing: https://huggingface.co/mrm8488/t5-small-finetuned-quora-for-paraphrasing
.. _p-christ/12412fsasf: https://huggingface.co/p-christ/12412fsasf
.. _tscholak/3vnuv1vf: https://huggingface.co/tscholak/3vnuv1vf
.. _tennessejoyce/titlewave-t5-base: https://huggingface.co/tennessejoyce/titlewave-t5-base
.. _vennify/t5-base-grammar-correction: https://huggingface.co/vennify/t5-base-grammar-correction
.. _megagonlabs/t5-base-japanese-web: https://huggingface.co/megagonlabs/t5-base-japanese-web
.. _sberbank-ai/ruT5-large: https://huggingface.co/sberbank-ai/ruT5-large
.. _tscholak/t5.1.1.lm100k.base: https://huggingface.co/tscholak/t5.1.1.lm100k.base
.. _deep-learning-analytics/GrammarCorrector: https://huggingface.co/deep-learning-analytics/GrammarCorrector
.. _ThomasNLG/t5-qa_squad2neg-en: https://huggingface.co/ThomasNLG/t5-qa_squad2neg-en
.. _t5-small-wav2vec2-grammar-fixer: https://huggingface.co/t5-small-wav2vec2-grammar-fixer
.. _KETI-AIR/ke-t5-small: https://huggingface.co/KETI-AIR/ke-t5-small
.. _razent/SciFive-large-Pubmed_PMC: https://huggingface.co/razent/SciFive-large-Pubmed_PMC
.. _google/t5-large-ssm-nq: https://huggingface.co/google/t5-large-ssm-nq
.. _ozcangundes/T5-base-for-BioQA: https://huggingface.co/ozcangundes/T5-base-for-BioQA
.. _Rostlab/prot_t5_base_mt_uniref50: https://huggingface.co/Rostlab/prot_t5_base_mt_uniref50
.. _sonoisa/t5-base-japanese-question-generation: https://huggingface.co/sonoisa/t5-base-japanese-question-generation
.. _Wikidepia/IndoT5-base: https://huggingface.co/Wikidepia/IndoT5-base
.. _razent/SciFive-base-Pubmed_PMC: https://huggingface.co/razent/SciFive-base-Pubmed_PMC
.. _google/t5-small-ssm-nq: https://huggingface.co/google/t5-small-ssm-nq
.. _flexudy/t5-small-wav2vec2-grammar-fixer: https://huggingface.co/flexudy/t5-small-wav2vec2-grammar-fixer