Skip to content

GitLab

"examples/git@developer.sourcefind.cn:OpenDAS/torchaudio.git" did not exist on "d4644793c4f949ec92a9205b70ab49e36a6137e6"
Unverified Commit b04df75a authored by fzyzcjy's avatar fzyzcjy Committed by GitHub
Browse files

Fix DeepEP error in some environments (#7154)

parent bec3e484
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
python/sglang/srt/layers/moe/ep_moe/token_dispatcher.py
View file @ b04df75a
...@@ -107,6 +107,8 @@ class DeepEPBuffer: ...@@ -107,6 +107,8 @@ class DeepEPBuffer:
num_rdma_bytes, num_rdma_bytes,
low_latency_mode=deepep_mode.enable_low_latency(), low_latency_mode=deepep_mode.enable_low_latency(),
num_qps_per_rank=num_qps_per_rank, num_qps_per_rank=num_qps_per_rank,
# TODO can be false when unneeded
allow_mnnvl=True,
) )
return cls._buffer return cls._buffer
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment