Skip to content

GitLab

Unverified Commit aa205609 authored by Xiaoyu Zhang's avatar Xiaoyu Zhang Committed by GitHub
Browse files

delete uselese code caused by fuse allreduce+add_rmsnorm pr (#7970)

parent 61bb2858
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 5 deletions
python/sglang/srt/models/deepseek_v2.py
View file @ aa205609
......@@ -1895,11 +1895,6 @@ class DeepseekV2DecoderLayer(nn.Module):
hidden_states, residual, forward_batch
)
if self.enable_dp_attention and self.speculative_algorithm.is_eagle():
# NOTE: this line resolves the degradation of MTP reception rate for non-zero DP ranks.
# See discussion here (https://github.com/sgl-project/sglang/pull/6081#discussion_r2147452251).
hidden_states = hidden_states.clone()
return hidden_states, residual
def op_comm_prepare_attn(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment