Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
fairscale
Commits
32b0b98e
Unverified
Commit
32b0b98e
authored
Jun 14, 2022
by
Crutcher Dunnavant
Committed by
GitHub
Jun 14, 2022
Browse files
Fix CI (#1010)
* Fix CI * ci pythonpath
parent
c506e7ed
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
10 additions
and
10 deletions
+10
-10
.circleci/config.yml
.circleci/config.yml
+9
-9
tests/optim/test_single_node_adascale.py
tests/optim/test_single_node_adascale.py
+1
-1
No files found.
.circleci/config.yml
View file @
32b0b98e
...
...
@@ -149,45 +149,45 @@ run_offload_benchmark: &run_offload_benchmark
-
run
:
name
:
Run Offload Benchmark
command
:
|
python benchmarks/experimental/offload.py --checkpoint_activation
PYTHONPATH=.
python benchmarks/experimental/offload.py --checkpoint_activation
run_fsdp_benchmark
:
&run_fsdp_benchmark
-
run
:
name
:
Run FSDP Benchmark
command
:
|
python benchmarks/fsdp.py --use_synthetic_data
PYTHONPATH=.
python benchmarks/fsdp.py --use_synthetic_data
run_pipe_benchmark
:
&run_pipe_benchmark
-
run
:
name
:
Run Pipe Benchmark
command
:
|
python benchmarks/pipe.py
PYTHONPATH=.
python benchmarks/pipe.py
run_oss_benchmark
:
&run_oss_benchmark
-
run
:
name
:
Run OSS Benchmark
command
:
|
python benchmarks/oss.py --world_size 4 --epochs 2
python benchmarks/oss.py --check_regression --world_size 4 --optim_type oss_sharded_ddp --epochs 12
PYTHONPATH=.
python benchmarks/oss.py --world_size 4 --epochs 2
PYTHONPATH=.
python benchmarks/oss.py --check_regression --world_size 4 --optim_type oss_sharded_ddp --epochs 12
run_oss_gloo
:
&run_oss_gloo
-
run
:
name
:
Run OSS with Gloo
command
:
|
python benchmarks/oss.py --gloo --optim_type oss_ddp --epochs 2
python benchmarks/oss.py --gloo --optim_type oss_sharded_ddp --epochs 2
PYTHONPATH=.
python benchmarks/oss.py --gloo --optim_type oss_ddp --epochs 2
PYTHONPATH=.
python benchmarks/oss.py --gloo --optim_type oss_sharded_ddp --epochs 2
run_oss_amp
:
&run_oss_amp
-
run
:
name
:
Run OSS with Torch AMP
command
:
|
python benchmarks/oss.py --amp --epochs 3 --optim_type oss_sharded_ddp
PYTHONPATH=.
python benchmarks/oss.py --amp --epochs 3 --optim_type oss_sharded_ddp
run_oss_for_each
:
&run_oss_for_each
-
run
:
name
:
Run OSS with Torch AMP and ForEach optmizer
command
:
|
python benchmarks/oss.py --amp --epochs 3 --optim_type oss_sharded_ddp --multi_tensor_optim
PYTHONPATH=.
python benchmarks/oss.py --amp --epochs 3 --optim_type oss_sharded_ddp --multi_tensor_optim
run_doc_build
:
&run_doc_build
-
run
:
...
...
tests/optim/test_single_node_adascale.py
View file @
32b0b98e
...
...
@@ -21,7 +21,7 @@ from torch.optim.lr_scheduler import LambdaLR
from
fair_dev.testing.golden_testing_data
import
adascale_test_data
from
fair_dev.testing.testing
import
make_cudnn_deterministic
,
skip_if_no_cuda
from
fairscale.
fair_dev.testing.testing_memory
import
find_tensor_by_shape
from
fair_dev.testing.testing_memory
import
find_tensor_by_shape
from
fairscale.optim
import
AdaScale
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment