Skip to content

GitLab

Commit 06ada31d authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-xiabo' into 'v0.9.2-dev' 

修改非堆成切分的判断

See merge request dcutoolkit/deeplearing/vllm!362
parents e89003dd f384ee43
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 4 deletions
vllm/distributed/kv_transfer/kv_connector/v1/p2p/p2p_nccl_engine.py
View file @ 06ada31d
...@@ -119,7 +119,7 @@ class P2pNcclEngine: ...@@ -119,7 +119,7 @@ class P2pNcclEngine:
"remote_pp_size", 1) "remote_pp_size", 1)
self.enable_asymmetric_p2p = self.config.get_from_extra_config( self.enable_asymmetric_p2p = self.config.get_from_extra_config(
"enable_asymmetric_p2p", False) "enable_asymmetric_p2p", False)
if self.enable_asymmetric_p2p == True:
if self.remote_tp_size % self.tp_size != 0: if self.remote_tp_size % self.tp_size != 0:
logger.error(" the Prefill TP size must be less than or equal to the Decode TP size!!!!") logger.error(" the Prefill TP size must be less than or equal to the Decode TP size!!!!")
self.multp = int(self.remote_tp_size / self.tp_size) self.multp = int(self.remote_tp_size / self.tp_size)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment