Skip to content

GitLab

Unverified Commit 61261b39 authored by Chen Shengzhi's avatar Chen Shengzhi Committed by GitHub
Browse files

[XCCL] Use xccl for xpu backend since xccl is ready in latest PyTorch. (#3954)

parent 19120f71
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
python/sglang/srt/model_executor/model_runner.py
View file @ 61261b39
...@@ -263,9 +263,7 @@ class ModelRunner: ...@@ -263,9 +263,7 @@ class ModelRunner:
if self.device == "cuda": if self.device == "cuda":
backend = "nccl" backend = "nccl"
elif self.device == "xpu": elif self.device == "xpu":
# TODO(liangan1): Just use gloo to bypass the initilization fail backend = "xccl"
# Need to use xccl for xpu backend in the future
backend = "gloo"
elif self.device == "hpu": elif self.device == "hpu":
backend = "hccl" backend = "hccl"
elif self.device == "cpu": elif self.device == "cpu":
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment