Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
b2e65cb4
Unverified
Commit
b2e65cb4
authored
Oct 30, 2025
by
Seiji Eicher
Committed by
GitHub
Oct 30, 2025
Browse files
[benchmark] Make request IDs unique across clients by default (#27723)
Signed-off-by:
Seiji Eicher
<
seiji@anyscale.com
>
parent
2bf0bcc1
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
vllm/benchmarks/serve.py
vllm/benchmarks/serve.py
+2
-1
No files found.
vllm/benchmarks/serve.py
View file @
b2e65cb4
...
@@ -26,6 +26,7 @@ import os
...
@@ -26,6 +26,7 @@ import os
import
random
import
random
import
shutil
import
shutil
import
time
import
time
import
uuid
import
warnings
import
warnings
from
collections.abc
import
AsyncGenerator
,
Iterable
from
collections.abc
import
AsyncGenerator
,
Iterable
from
dataclasses
import
dataclass
from
dataclasses
import
dataclass
...
@@ -1160,7 +1161,7 @@ def add_cli_args(parser: argparse.ArgumentParser):
...
@@ -1160,7 +1161,7 @@ def add_cli_args(parser: argparse.ArgumentParser):
"--request-id-prefix"
,
"--request-id-prefix"
,
type
=
str
,
type
=
str
,
required
=
False
,
required
=
False
,
default
=
"bench
mark-serving
"
,
default
=
f
"bench
-
{
uuid
.
uuid4
().
hex
[:
8
]
}
-
"
,
help
=
"Specify the prefix of request id."
,
help
=
"Specify the prefix of request id."
,
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment