Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
a79151c8
Unverified
Commit
a79151c8
authored
Oct 24, 2025
by
ryan-lempka
Committed by
GitHub
Oct 24, 2025
Browse files
fix: ignore stop key in vllm sampling params (#3879)
Signed-off-by:
Ryan Lempka
<
rlempka@nvidia.com
>
parent
77cecf4e
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
0 deletions
+3
-0
components/src/dynamo/vllm/handlers.py
components/src/dynamo/vllm/handlers.py
+3
-0
No files found.
components/src/dynamo/vllm/handlers.py
View file @
a79151c8
...
...
@@ -44,6 +44,9 @@ def build_sampling_params(
# Apply stop_conditions
for
key
,
value
in
request
[
"stop_conditions"
].
items
():
if
value
is
not
None
and
hasattr
(
sampling_params
,
key
):
# Do not add stop key to sampling params - dynamo handles stop conditions directly
if
key
==
"stop"
:
continue
setattr
(
sampling_params
,
key
,
value
)
return
sampling_params
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment