Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
FastMoE
Commits
33fc3aca
Commit
33fc3aca
authored
Oct 10, 2021
by
Rick Ho
Browse files
update unit test
parent
d9dba929
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
tests/test_numerical.py
tests/test_numerical.py
+2
-1
No files found.
tests/test_numerical.py
View file @
33fc3aca
...
...
@@ -342,7 +342,8 @@ def _test_fmoe_local_ddp(rank, world_size, mp_group, dp_group, world_group):
torch
.
cuda
.
manual_seed
(
42
+
rank
)
model
=
MyModule
().
cuda
()
model_ddp
=
LocalDDP
(
deepcopy
(
model
),
mp_group
,
dp_group
,
world_group
)
model_ddp
=
LocalDDP
(
deepcopy
(
model
),
mp_group
=
mp_group
,
dp_group
=
dp_group
,
world_group
=
world_group
)
model
.
set_comm
()
model_ddp
.
module
.
set_comm
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment