Skip to content

GitLab

Unverified Commit 1f5febb4 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[UX nit] Fix non-default api_server_count message (#34152) 


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent ae871ca9
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/entrypoints/cli/serve.py
View file @ 1f5febb4
...@@ -108,6 +108,7 @@ class ServeSubcommand(CLISubcommand): ...@@ -108,6 +108,7 @@ class ServeSubcommand(CLISubcommand):
run_multi_api_server(args) run_multi_api_server(args)
else: else:
# Single API server (this process). # Single API server (this process).
args.api_server_count = None
uvloop.run(run_server(args)) uvloop.run(run_server(args))
def validate(self, args: argparse.Namespace) -> None: def validate(self, args: argparse.Namespace) -> None:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment