Skip to content

GitLab

"...text-generation-inference.git" did not exist on "6db3bcb700e62134b35d87169e88907543583a16"
Unverified Commit a5f5568d authored by Sourab Mangrulkar's avatar Sourab Mangrulkar Committed by GitHub
Browse files

Make fsdp ram efficient loading optional (#26631) 

make fsdp ram efficient loading optional
parent 5d997f22
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
src/transformers/modeling_utils.py
View file @ a5f5568d
...@@ -125,6 +125,7 @@ def is_fsdp_enabled(): ...@@ -125,6 +125,7 @@ def is_fsdp_enabled():
torch.distributed.is_available() torch.distributed.is_available()
and torch.distributed.is_initialized() and torch.distributed.is_initialized()
and strtobool(os.environ.get("ACCELERATE_USE_FSDP", "False")) == 1 and strtobool(os.environ.get("ACCELERATE_USE_FSDP", "False")) == 1
and strtobool(os.environ.get("FSDP_CPU_RAM_EFFICIENT_LOADING", "False")) == 1
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment