Skip to content

GitLab

Commit ffd26247 authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-wm' into 'v0.9.2-dev' 

[fix]修复tp1 dpsk启动失败

See merge request dcutoolkit/deeplearing/vllm!433
parents ad7c14d5 b6a7135f
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/model_executor/models/deepseek_v2.py
View file @ ffd26247
...@@ -484,7 +484,8 @@ class DeepseekV2MoE(nn.Module): ...@@ -484,7 +484,8 @@ class DeepseekV2MoE(nn.Module):
final_hidden_states = ( final_hidden_states = (
self.experts.maybe_all_reduce_tensor_model_parallel( self.experts.maybe_all_reduce_tensor_model_parallel(
final_hidden_states)) final_hidden_states))
return final_hidden_states.view(num_tokens, hidden_dim)
return final_hidden_states.view(num_tokens, hidden_dim)
def yarn_get_mscale(scale: float = 1, mscale: float = 1) -> float: def yarn_get_mscale(scale: float = 1, mscale: float = 1) -> float:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment