Skip to content

GitLab

Unverified Commit 1a08ba19 authored by Sangkug Lym's avatar Sangkug Lym Committed by GitHub
Browse files

zero inter-node communication buffer (#163) 


Signed-off-by: default avatarSangkug Lym <slym@nvidia.com>
Co-authored-by: default avatarKirthi Shankar Sivamani <ksivamani@nvidia.com>
parent 989a53a0
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
transformer_engine/pytorch/csrc/userbuffers/userbuffers.h
View file @ 1a08ba19
...@@ -34,8 +34,6 @@ ...@@ -34,8 +34,6 @@
#define NVTE_REG0_FLAGS (NVTE_REG0_RECV + NVTE_MAX_PEERS * NVTE_MAX_REGIONS) #define NVTE_REG0_FLAGS (NVTE_REG0_RECV + NVTE_MAX_PEERS * NVTE_MAX_REGIONS)
#define NVTE_REG0_IBRS 32 #define NVTE_REG0_IBRS 32
#define NVTE_REG0_IBAG 512 #define NVTE_REG0_IBAG 512
#undef NVTE_REG0_COMMBUFFER
#define NVTE_REG0_COMMBUFFER (1024 * 1024 * 16)
// gpuflags map offsets // gpuflags map offsets
#define NVTE_GF_STATE 16000 #define NVTE_GF_STATE 16000
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment