Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
bd6d5a74
Unverified
Commit
bd6d5a74
authored
Dec 22, 2025
by
AlonKejzman
Committed by
GitHub
Dec 22, 2025
Browse files
[gpt-oss] Fix harmony parser in streaming responses (#30205)
Signed-off-by:
AlonKejzman
<
alonkeizman@gmail.com
>
parent
256a33ec
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
0 deletions
+5
-0
vllm/entrypoints/openai/serving_chat.py
vllm/entrypoints/openai/serving_chat.py
+5
-0
No files found.
vllm/entrypoints/openai/serving_chat.py
View file @
bd6d5a74
...
...
@@ -811,6 +811,11 @@ class OpenAIServingChat(OpenAIServing):
delta_text
+=
harmony_parser
.
last_content_delta
or
""
cur_channel
=
harmony_parser
.
current_channel
cur_recipient
=
harmony_parser
.
current_recipient
# handle the case where several tokens where generated at once
# including the final token, leading to a delta in the text
# but the current channel to be empty (start state)
if
not
cur_channel
and
delta_text
:
cur_channel
=
"final"
else
:
delta_text
=
output
.
text
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment