Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
0f2c7382
"docs/source/ko/tasks/summarization.md" did not exist on "77321481247787c97568c3b9f64b19e22351bab8"
Unverified
Commit
0f2c7382
authored
May 17, 2023
by
Hugo Abonizio
Committed by
GitHub
May 17, 2023
Browse files
Remove hardcoded prints in Trainer (#23432)
parent
a574de30
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
src/transformers/trainer.py
src/transformers/trainer.py
+2
-2
No files found.
src/transformers/trainer.py
View file @
0f2c7382
...
...
@@ -1105,10 +1105,10 @@ class Trainer:
for
module
in
opt_model
.
modules
():
if
isinstance
(
module
,
nn
.
Embedding
):
skipped
+=
sum
({
p
.
data_ptr
():
p
.
numel
()
for
p
in
module
.
parameters
()}.
values
())
print
(
f
"skipped
{
module
}
:
{
skipped
/
2
**
20
}
M params"
)
logger
.
info
(
f
"skipped
{
module
}
:
{
skipped
/
2
**
20
}
M params"
)
manager
.
register_module_override
(
module
,
"weight"
,
{
"optim_bits"
:
32
})
logger
.
debug
(
f
"bitsandbytes: will optimize
{
module
}
in fp32"
)
print
(
f
"skipped:
{
skipped
/
2
**
20
}
M params"
)
logger
.
info
(
f
"skipped:
{
skipped
/
2
**
20
}
M params"
)
if
is_sagemaker_mp_enabled
():
self
.
optimizer
=
smp
.
DistributedOptimizer
(
self
.
optimizer
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment