Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
apex
Commits
d8db8c15
Commit
d8db8c15
authored
Apr 05, 2022
by
Thor Johnsen
Browse files
Rename nccl_p2p extension to nccl_p2p_cuda
parent
6e7e2d90
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
3 additions
and
3 deletions
+3
-3
apex/contrib/bottleneck/bottleneck.py
apex/contrib/bottleneck/bottleneck.py
+1
-1
apex/contrib/bottleneck/halo_exchangers.py
apex/contrib/bottleneck/halo_exchangers.py
+1
-1
setup.py
setup.py
+1
-1
No files found.
apex/contrib/bottleneck/bottleneck.py
View file @
d8db8c15
...
...
@@ -2,7 +2,7 @@ import torch
import
torch.distributed
as
dist
from
torch
import
nn
import
fast_bottleneck
import
nccl_p2p
as
inc
import
nccl_p2p
_cuda
as
inc
def
kaiming_uniform_
(
tensor
,
a
=
0
,
mode
=
'fan_in'
,
nonlinearity
=
'leaky_relu'
):
weight_tensor_nchw
=
tensor
...
...
apex/contrib/bottleneck/halo_exchangers.py
View file @
d8db8c15
import
torch
import
torch.distributed
as
dist
from
torch
import
nn
import
nccl_p2p
as
inc
import
nccl_p2p
_cuda
as
inc
import
peer_memory_cuda
as
pm
# Communication free halo exchanger.
...
...
setup.py
View file @
d8db8c15
...
...
@@ -646,7 +646,7 @@ if "--nccl_p2p" in sys.argv:
raise_if_cuda_home_none
(
"--nccl_p2p"
)
ext_modules
.
append
(
CUDAExtension
(
name
=
"nccl_p2p"
,
name
=
"nccl_p2p
_cuda
"
,
sources
=
[
"apex/contrib/csrc/nccl_p2p/nccl_p2p_cuda.cu"
,
"apex/contrib/csrc/nccl_p2p/nccl_p2p.cpp"
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment