Commit 42ade7fa authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-ds-wm' into 'v0.9.2-dev-ds'

[fix]修复开启dp并且不开启ep报vmfault

See merge request dcutoolkit/deeplearing/vllm!225
parents 48eb976d f0f159a4
...@@ -1537,6 +1537,7 @@ class FusedMoE(torch.nn.Module): ...@@ -1537,6 +1537,7 @@ class FusedMoE(torch.nn.Module):
do_naive_dispatch_combine: bool = ( do_naive_dispatch_combine: bool = (
self.dp_size > 1 self.dp_size > 1
and self.ep_size > 1
and not self.moe_parallel_config.use_deepep_ht_kernels) and not self.moe_parallel_config.use_deepep_ht_kernels)
if do_naive_dispatch_combine: if do_naive_dispatch_combine:
hidden_states, router_logits = get_ep_group().dispatch( hidden_states, router_logits = get_ep_group().dispatch(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment