Skip to content

GitLab

Unverified Commit d54af615 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Bugfix] Fix PP default fallback behavior for V1 (#18915) 


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent a1cc9f33
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/engine/arg_utils.py
View file @ d54af615
...@@ -1380,7 +1380,8 @@ class EngineArgs: ...@@ -1380,7 +1380,8 @@ class EngineArgs:
if (self.pipeline_parallel_size > 1 if (self.pipeline_parallel_size > 1
and self.distributed_executor_backend and self.distributed_executor_backend
not in ("ray", "mp", "external_launcher")): not in (ParallelConfig.distributed_executor_backend, "ray",
"mp", "external_launcher")):
name = "Pipeline Parallelism without Ray distributed executor " \ name = "Pipeline Parallelism without Ray distributed executor " \
"or multiprocessing executor or external launcher" "or multiprocessing executor or external launcher"
_raise_or_fallback(feature_name=name, recommend_to_remove=False) _raise_or_fallback(feature_name=name, recommend_to_remove=False)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment