Skip to content

GitLab

Unverified Commit 14c79c3e authored by Stas Bekman's avatar Stas Bekman Committed by GitHub
Browse files

native amp leak fix landed in 1.7.1 (#9115) 

update README with good news that the leak fix has been applied to pytorch-1.7.1.
parent ed1845ef
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/seq2seq/README.md
View file @ 14c79c3e
......@@ -97,7 +97,7 @@ The `.source` files are the input, the `.target` files are the desired output.
### Potential issues
- native AMP (`--fp16` and no apex) may lead to a huge memory leak and require 10x gpu memory. This has been fixed in pytorch-nightly and the minimal official version to have this fix will be pytorch-1.8. Until then if you have to use mixed precision please use AMP only with pytorch-nightly or NVIDIA's apex. Reference: https://github.com/huggingface/transformers/issues/8403
- native AMP (`--fp16` and no apex) may lead to a huge memory leak and require 10x gpu memory. This has been fixed in pytorch-nightly and the minimal official version to have this fix will be pytorch-1.7.1. Until then if you have to use mixed precision please use AMP only with pytorch-nightly or NVIDIA's apex. Reference: https://github.com/huggingface/transformers/issues/8403
### Tips and Tricks
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment