Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
90ed9ae2
"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "d0d1632958c7d543e07afc672a8501d704e5a65f"
Unverified
Commit
90ed9ae2
authored
Jun 09, 2022
by
Stas Bekman
Committed by
GitHub
Jun 09, 2022
Browse files
fix use_amp rename after pr 17138 (#17636)
parent
c70dacde
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
7 additions
and
2 deletions
+7
-2
src/transformers/modelcard.py
src/transformers/modelcard.py
+1
-1
src/transformers/trainer.py
src/transformers/trainer.py
+6
-1
No files found.
src/transformers/modelcard.py
View file @
90ed9ae2
...
...
@@ -894,7 +894,7 @@ def extract_hyperparameters_from_trainer(trainer):
hyperparameters
[
"num_epochs"
]
=
trainer
.
args
.
num_train_epochs
if
trainer
.
args
.
fp16
:
if
trainer
.
use_amp
:
if
trainer
.
use_
cuda_
amp
:
hyperparameters
[
"mixed_precision_training"
]
=
"Native AMP"
elif
trainer
.
use_apex
:
hyperparameters
[
"mixed_precision_training"
]
=
f
"Apex, opt level
{
trainer
.
args
.
fp16_opt_level
}
"
...
...
src/transformers/trainer.py
View file @
90ed9ae2
...
...
@@ -546,7 +546,12 @@ class Trainer:
self
.
use_apex
=
True
# FP16 + model parallelism in SageMaker: gradient clipping does not work for now so we raise a helpful error.
if
is_sagemaker_mp_enabled
()
and
self
.
use_amp
and
args
.
max_grad_norm
is
not
None
and
args
.
max_grad_norm
>
0
:
if
(
is_sagemaker_mp_enabled
()
and
self
.
use_cuda_amp
and
args
.
max_grad_norm
is
not
None
and
args
.
max_grad_norm
>
0
):
raise
ValueError
(
"SageMaker Model Parallelism in mixed precision mode does not support gradient clipping yet. Pass "
"along 'max_grad_norm': 0 in your hyperparameters."
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment