Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
FastMoE
Commits
3be6ac10
Commit
3be6ac10
authored
Jan 03, 2021
by
Jiezhong Qiu
Browse files
update
parent
6212aa28
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
1 deletion
+0
-1
pytorch/cuda/moe.py
pytorch/cuda/moe.py
+0
-1
No files found.
pytorch/cuda/moe.py
View file @
3be6ac10
...
@@ -133,7 +133,6 @@ def test_dp():
...
@@ -133,7 +133,6 @@ def test_dp():
moe
=
MOELayer
(
num_expert
,
in_feat
,
out_feat
).
cuda
()
moe
=
MOELayer
(
num_expert
,
in_feat
,
out_feat
).
cuda
()
moe_dp
=
torch
.
nn
.
DataParallel
(
moe
,
device_ids
=
[
0
,
1
,
2
])
moe_dp
=
torch
.
nn
.
DataParallel
(
moe
,
device_ids
=
[
0
,
1
,
2
])
for
i
in
range
(
5
):
for
i
in
range
(
5
):
print
(
i
,
"forward"
)
output
=
moe_dp
(
inp
,
gate
)
output
=
moe_dp
(
inp
,
gate
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment