Skip to content

GitLab

Unverified Commit 486dd1d9 authored by Zhiyi Hu's avatar Zhiyi Hu Committed by GitHub
Browse files

remove redundant variable num_scales (#265) 


Co-authored-by: default avatarzhiyi Hu <zhiyihu@U-NYQQMGK0-2250.local>
parent 8b0c5944
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
csrc/deep_ep.cpp
View file @ 486dd1d9
...@@ -1096,7 +1096,7 @@ Buffer::low_latency_dispatch(const torch::Tensor& x, const torch::Tensor& topk_i ...@@ -1096,7 +1096,7 @@ Buffer::low_latency_dispatch(const torch::Tensor& x, const torch::Tensor& topk_i
} }
auto num_tokens = static_cast<int>(x.size(0)), hidden = static_cast<int>(x.size(1)); auto num_tokens = static_cast<int>(x.size(0)), hidden = static_cast<int>(x.size(1));
auto num_scales = hidden / 128, num_topk = static_cast<int>(topk_idx.size(1)); auto num_topk = static_cast<int>(topk_idx.size(1));
auto num_local_experts = num_experts / num_ranks; auto num_local_experts = num_experts / num_ranks;
// Buffer control // Buffer control
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment