Commit f0f159a4 authored by 王敏's avatar 王敏
Browse files

[fix]修复开启dp并且不开启ep报vmfault

parent 48eb976d
...@@ -1537,6 +1537,7 @@ class FusedMoE(torch.nn.Module): ...@@ -1537,6 +1537,7 @@ class FusedMoE(torch.nn.Module):
do_naive_dispatch_combine: bool = ( do_naive_dispatch_combine: bool = (
self.dp_size > 1 self.dp_size > 1
and self.ep_size > 1
and not self.moe_parallel_config.use_deepep_ht_kernels) and not self.moe_parallel_config.use_deepep_ht_kernels)
if do_naive_dispatch_combine: if do_naive_dispatch_combine:
hidden_states, router_logits = get_ep_group().dispatch( hidden_states, router_logits = get_ep_group().dispatch(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment