Merge branch 'hepj-test' into 'main'

更新transformer代码 See merge request dcutoolkit/deeplearing/dlexamples_new!47

Merge branch 'hepj-test' into 'main'
更新transformer代码 See merge request dcutoolkit/deeplearing/dlexamples_new!47
7143f128 · sunxx1 · a30b77fe · c0f05c10 · 7143f128 · 7143f128
Commit 7143f128 authored Jan 09, 2023 by sunxx1
20 changed files
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/composite.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/composite.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/cpu_adam.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/cpu_adam.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/dynamic_loss_scaler.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/dynamic_loss_scaler.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/fairseq_optimizer.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/fairseq_optimizer.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/fp16_optimizer.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/fp16_optimizer.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/fused_adam.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/fused_adam.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/fused_lamb.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/fused_lamb.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/__init__.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/__init__.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py
--- a/PyTorch/NLP/Transformer/fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py
+++ b/PyTorch/NLP/Transformer/fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/fixed_schedule.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/fixed_schedule.py
--- a/PyTorch/NLP/Transformer/fairseq/optim/lr_scheduler/inverse_square_root_schedule.py
+++ b/PyTorch/NLP/Transformer/fairseq/optim/lr_scheduler/inverse_square_root_schedule.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/manual_lr_scheduler.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/manual_lr_scheduler.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/pass_through.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/pass_through.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/polynomial_decay_schedule.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/polynomial_decay_schedule.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/step_lr_scheduler.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/step_lr_scheduler.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/tri_stage_lr_scheduler.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/tri_stage_lr_scheduler.py
--- a/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py
+++ b/PyTorch/NLP/new-Transformer/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py
--- a/PyTorch/NLP/Transformer/fairseq/optim/nag.py
+++ b/PyTorch/NLP/Transformer/fairseq/optim/nag.py