Merge branch 'hepj-test' into 'main'

更新transformer代码 See merge request dcutoolkit/deeplearing/dlexamples_new!47

Merge branch 'hepj-test' into 'main'
更新transformer代码 See merge request dcutoolkit/deeplearing/dlexamples_new!47
7143f128 · sunxx1 · a30b77fe · c0f05c10 · 7143f128 · 7143f128
Commit 7143f128 authored Jan 09, 2023 by sunxx1
20 changed files
--- a/PyTorch/NLP/new-Transformer/fairseq/data/iterators.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/iterators.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/language_pair_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/language_pair_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/legacy/__init__.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/legacy/__init__.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/legacy/block_pair_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/legacy/block_pair_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/legacy/masked_lm_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/legacy/masked_lm_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/legacy/masked_lm_dictionary.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/legacy/masked_lm_dictionary.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/list_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/list_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/lm_context_window_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/lm_context_window_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/lru_cache_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/lru_cache_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/mask_tokens_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/mask_tokens_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/monolingual_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/monolingual_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multi_corpus_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multi_corpus_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multi_corpus_sampled_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multi_corpus_sampled_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/__init__.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/__init__.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/multilingual_data_manager.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/multilingual_data_manager.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/multilingual_utils.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/multilingual_utils.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/sampled_multi_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/sampled_multi_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/sampled_multi_epoch_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/sampled_multi_epoch_dataset.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/sampling_method.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/multilingual/sampling_method.py
--- a/PyTorch/NLP/new-Transformer/fairseq/data/nested_dictionary_dataset.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/data/nested_dictionary_dataset.py