Skip to content

GitLab

Unverified Commit dcf46f1c authored by Chenggang Zhao's avatar Chenggang Zhao Committed by GitHub
Browse files

Merge pull request #96 from songhexiang/adjust_kNumThreads_of_notify_dispatch 

Adjust kNumThreads of notify_dispatch
parents e130cc6e 4dd1e68a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
csrc/kernels/internode.cu
View file @ dcf46f1c
...@@ -428,7 +428,7 @@ void notify_dispatch(const int* num_tokens_per_rank, int* moe_recv_counter_mappe ...@@ -428,7 +428,7 @@ void notify_dispatch(const int* num_tokens_per_rank, int* moe_recv_counter_mappe
buffer_ptrs, task_fifo_ptrs, head, rank, \ buffer_ptrs, task_fifo_ptrs, head, rank, \
cpu_rdma_team); } break cpu_rdma_team); } break
constexpr int kNumThreads = 256; constexpr int kNumThreads = std::max(256, 32 * num_channels);
const auto num_rdma_ranks = num_ranks / NUM_MAX_NVL_PEERS; const auto num_rdma_ranks = num_ranks / NUM_MAX_NVL_PEERS;
// Get clean meta // Get clean meta
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment