------------------------------------ T5模型汇总 ------------------------------------ 下表汇总介绍了目前PaddleNLP支持的T5模型对应预训练权重。 关于模型的具体细节可以参考对应链接。 +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ | Pretrained Weight | Language | Details of the model | +==================================================================================+==============+==================================================================================+ |``t5-small`` | English | 6-layer, 512-hidden, | | | | 8-heads, 93M parameters. | | | | T5 small model. | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``t5-base`` | English | 12-layer, 768-hidden, | | | | 12-heads, 272M parameters. | | | | T5 base model. | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``t5-large`` | English | 24-layer, 1024-hidden, | | | | 16-heads, 803M parameters. | | | | T5 large model. | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``t5-v1_1-base`` | English | Please refer to: | | | | t5-v1_1-base_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``t5-v1_1-large`` | English | Please refer to: | | | | t5-v1_1-large_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``Langboat/mengzi-t5-base`` | Chinese | Please refer to: | | | | `Langboat/mengzi-t5-base`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``Langboat/mengzi-t5-base-mt`` | Chinese | Please refer to: | | | | `Langboat/mengzi-t5-base-mt`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``deep-learning-analytics/wikihow-t5-small`` | English | Please refer to: | | | | `deep-learning-analytics/wikihow-t5-small`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``sberbank-ai/ruT5-base`` | English | Please refer to: | | | | `sberbank-ai/ruT5-base`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``Michau/t5-base-en-generate-headline`` | English | Please refer to: | | | | `Michau/t5-base-en-generate-headline`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``google/t5-v1_1-small`` | English | Please refer to: | | | | `google/t5-v1_1-small`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``prithivida/parrot_paraphraser_on_T5`` | English | Please refer to: | | | | `prithivida/parrot_paraphraser_on_T5`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``prithivida/grammar_error_correcter_v1`` | English | Please refer to: | | | | `prithivida/grammar_error_correcter_v1`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``valhalla/t5-small-qg-hl`` | English | Please refer to: | | | | `valhalla/t5-small-qg-hl`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``valhalla/t5-small-qa-qg-hl`` | English | Please refer to: | | | | `valhalla/t5-small-qa-qg-hl`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``ramsrigouthamg/t5-large-paraphraser-diverse-high-quality`` | English | Please refer to: | | | | `ramsrigouthamg/t5-large-paraphraser-diverse-high-quality`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``mrm8488/t5-base-finetuned-common_gen`` | English | Please refer to: | | | | `mrm8488/t5-base-finetuned-common_gen`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``valhalla/t5-small-e2e-qg`` | English | Please refer to: | | | | `valhalla/t5-small-e2e-qg`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``sonoisa/t5-base-japanese`` | japanese | Please refer to: | | | | `sonoisa/t5-base-japanese`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``google/t5-base-lm-adapt`` | English | Please refer to: | | | | `google/t5-base-lm-adapt`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``google/t5-small-lm-adapt`` | English | Please refer to: | | | | `google/t5-small-lm-adapt`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``valhalla/t5-small-qg-prepend`` | English | Please refer to: | | | | `valhalla/t5-small-qg-prepend`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``prithivida/informal_to_formal_styletransfer`` | English | Please refer to: | | | | `prithivida/informal_to_formal_styletransfer`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``KETI-AIR/ke-t5-base`` | English | Please refer to: | | | | `KETI-AIR/ke-t5-base`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``nielsr/nt5-small-rc1`` | English | Please refer to: | | | | `nielsr/nt5-small-rc1`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``snrspeaks/t5-one-line-summary`` | English | Please refer to: | | | | `snrspeaks/t5-one-line-summary`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``mrm8488/t5-small-finetuned-quora-for-paraphrasing`` | English | Please refer to: | | | | `mrm8488/t5-small-finetuned-quora-for-paraphrasing`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``p-christ/12412fsasf`` | English | Please refer to: | | | | `p-christ/12412fsasf`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``tscholak/3vnuv1vf`` | English | Please refer to: | | | | `tscholak/3vnuv1vf`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``tennessejoyce/titlewave-t5-base`` | English | Please refer to: | | | | `tennessejoyce/titlewave-t5-base`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``vennify/t5-base-grammar-correction`` | English | Please refer to: | | | | `vennify/t5-base-grammar-correction`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``megagonlabs/t5-base-japanese-web`` | Japanese | Please refer to: | | | | `megagonlabs/t5-base-japanese-web`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``sberbank-ai/ruT5-large`` | English | Please refer to: | | | | `sberbank-ai/ruT5-large`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``tscholak/t5.1.1.lm100k.base`` | English | Please refer to: | | | | `tscholak/t5.1.1.lm100k.base`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``deep-learning-analytics/GrammarCorrector`` | English | Please refer to: | | | | `deep-learning-analytics/GrammarCorrector`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``ThomasNLG/t5-qa_squad2neg-en`` | English | Please refer to: | | | | `ThomasNLG/t5-qa_squad2neg-en`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``flexudy/t5-small-wav2vec2-grammar-fixer`` | English | Please refer to: | | | | `flexudy/t5-small-wav2vec2-grammar-fixer`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``KETI-AIR/ke-t5-small`` | English | Please refer to: | | | | `KETI-AIR/ke-t5-small`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``razent/SciFive-large-Pubmed_PMC`` | English | Please refer to: | | | | `razent/SciFive-large-Pubmed_PMC`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``google/t5-large-ssm-nq`` | English | Please refer to: | | | | `google/t5-large-ssm-nq`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``ozcangundes/T5-base-for-BioQA`` | English | Please refer to: | | | | `ozcangundes/T5-base-for-BioQA`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``Rostlab/prot_t5_base_mt_uniref50`` | English | Please refer to: | | | | `Rostlab/prot_t5_base_mt_uniref50`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``sonoisa/t5-base-japanese-question-generation`` | Japanese | Please refer to: | | | | `sonoisa/t5-base-japanese-question-generation`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``Wikidepia/IndoT5-base`` | English | Please refer to: | | | | `Wikidepia/IndoT5-base`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``razent/SciFive-base-Pubmed_PMC`` | English | Please refer to: | | | | `razent/SciFive-base-Pubmed_PMC`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ |``google/t5-small-ssm-nq`` | English | Please refer to: | | | | `google/t5-small-ssm-nq`_ | +----------------------------------------------------------------------------------+--------------+----------------------------------------------------------------------------------+ .. _t5-v1_1-base: https://huggingface.co/google/t5-v1_1-base .. _t5-v1_1-large: https://huggingface.co/google/t5-v1_1-large .. _Langboat/mengzi-t5-base: https://huggingface.co/Langboat/mengzi-t5-base .. _Langboat/mengzi-t5-base-mt: https://huggingface.co/Langboat/mengzi-t5-base-mt .. _deep-learning-analytics/wikihow-t5-small: https://huggingface.co/deep-learning-analytics/wikihow-t5-small .. _sberbank-ai/ruT5-base: https://huggingface.co/sberbank-ai/ruT5-base .. _Michau/t5-base-en-generate-headline: https://huggingface.co/Michau/t5-base-en-generate-headline .. _google/t5-v1_1-small: https://huggingface.co/google/t5-v1_1-small .. _prithivida/parrot_paraphraser_on_T5: https://huggingface.co/prithivida/parrot_paraphraser_on_T5 .. _prithivida/grammar_error_correcter_v1: https://huggingface.co/prithivida/grammar_error_correcter_v1 .. _valhalla/t5-small-qg-hl: https://huggingface.co/valhalla/t5-small-qg-hl .. _valhalla/t5-small-qa-qg-hl: https://huggingface.co/valhalla/t5-small-qa-qg-hl .. _ramsrigouthamg/t5-large-paraphraser-diverse-high-quality: https://huggingface.co/ramsrigouthamg/t5-large-paraphraser-diverse-high-quality .. _mrm8488/t5-base-finetuned-common_gen: https://huggingface.co/mrm8488/t5-base-finetuned-common_gen .. _valhalla/t5-small-e2e-qg: https://huggingface.co/valhalla/t5-small-e2e-qg .. _sonoisa/t5-base-japanese: https://huggingface.co/sonoisa/t5-base-japanese .. _google/t5-base-lm-adapt: https://huggingface.co/google/t5-base-lm-adapt .. _google/t5-small-lm-adapt: https://huggingface.co/google/t5-small-lm-adapt .. _valhalla/t5-small-qg-prepend: https://huggingface.co/valhalla/t5-small-qg-prepend .. _prithivida/informal_to_formal_styletransfer: https://huggingface.co/prithivida/informal_to_formal_styletransfer .. _KETI-AIR/ke-t5-base: https://huggingface.co/KETI-AIR/ke-t5-base .. _nielsr/nt5-small-rc1: https://huggingface.co/nielsr/nt5-small-rc1 .. _snrspeaks/t5-one-line-summary: https://huggingface.co/snrspeaks/t5-one-line-summary .. _mrm8488/t5-small-finetuned-quora-for-paraphrasing: https://huggingface.co/mrm8488/t5-small-finetuned-quora-for-paraphrasing .. _p-christ/12412fsasf: https://huggingface.co/p-christ/12412fsasf .. _tscholak/3vnuv1vf: https://huggingface.co/tscholak/3vnuv1vf .. _tennessejoyce/titlewave-t5-base: https://huggingface.co/tennessejoyce/titlewave-t5-base .. _vennify/t5-base-grammar-correction: https://huggingface.co/vennify/t5-base-grammar-correction .. _megagonlabs/t5-base-japanese-web: https://huggingface.co/megagonlabs/t5-base-japanese-web .. _sberbank-ai/ruT5-large: https://huggingface.co/sberbank-ai/ruT5-large .. _tscholak/t5.1.1.lm100k.base: https://huggingface.co/tscholak/t5.1.1.lm100k.base .. _deep-learning-analytics/GrammarCorrector: https://huggingface.co/deep-learning-analytics/GrammarCorrector .. _ThomasNLG/t5-qa_squad2neg-en: https://huggingface.co/ThomasNLG/t5-qa_squad2neg-en .. _t5-small-wav2vec2-grammar-fixer: https://huggingface.co/t5-small-wav2vec2-grammar-fixer .. _KETI-AIR/ke-t5-small: https://huggingface.co/KETI-AIR/ke-t5-small .. _razent/SciFive-large-Pubmed_PMC: https://huggingface.co/razent/SciFive-large-Pubmed_PMC .. _google/t5-large-ssm-nq: https://huggingface.co/google/t5-large-ssm-nq .. _ozcangundes/T5-base-for-BioQA: https://huggingface.co/ozcangundes/T5-base-for-BioQA .. _Rostlab/prot_t5_base_mt_uniref50: https://huggingface.co/Rostlab/prot_t5_base_mt_uniref50 .. _sonoisa/t5-base-japanese-question-generation: https://huggingface.co/sonoisa/t5-base-japanese-question-generation .. _Wikidepia/IndoT5-base: https://huggingface.co/Wikidepia/IndoT5-base .. _razent/SciFive-base-Pubmed_PMC: https://huggingface.co/razent/SciFive-base-Pubmed_PMC .. _google/t5-small-ssm-nq: https://huggingface.co/google/t5-small-ssm-nq .. _flexudy/t5-small-wav2vec2-grammar-fixer: https://huggingface.co/flexudy/t5-small-wav2vec2-grammar-fixer