Commit ffd26247 authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-wm' into 'v0.9.2-dev'

[fix]修复tp1 dpsk启动失败

See merge request dcutoolkit/deeplearing/vllm!433
parents ad7c14d5 b6a7135f
......@@ -484,6 +484,7 @@ class DeepseekV2MoE(nn.Module):
final_hidden_states = (
self.experts.maybe_all_reduce_tensor_model_parallel(
final_hidden_states))
return final_hidden_states.view(num_tokens, hidden_dim)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment