Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
4d01b642
Unverified
Commit
4d01b642
authored
Nov 20, 2025
by
Software Developer
Committed by
GitHub
Nov 20, 2025
Browse files
[Bugfix] - Add Trace Headers to Beam Search Path (#29100)
Signed-off-by:
dsuhinin
<
suhinin.dmitriy@gmail.com
>
parent
114b0e25
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
4 additions
and
0 deletions
+4
-0
vllm/entrypoints/openai/serving_chat.py
vllm/entrypoints/openai/serving_chat.py
+1
-0
vllm/entrypoints/openai/serving_completion.py
vllm/entrypoints/openai/serving_completion.py
+1
-0
vllm/entrypoints/openai/serving_engine.py
vllm/entrypoints/openai/serving_engine.py
+2
-0
No files found.
vllm/entrypoints/openai/serving_chat.py
View file @
4d01b642
...
...
@@ -319,6 +319,7 @@ class OpenAIServingChat(OpenAIServing):
request_id
=
request_id
,
params
=
sampling_params
,
lora_request
=
lora_request
,
trace_headers
=
trace_headers
,
)
else
:
engine_request
,
tokenization_kwargs
=
await
self
.
_process_inputs
(
...
...
vllm/entrypoints/openai/serving_completion.py
View file @
4d01b642
...
...
@@ -216,6 +216,7 @@ class OpenAIServingCompletion(OpenAIServing):
request_id
=
request_id
,
params
=
sampling_params
,
lora_request
=
lora_request
,
trace_headers
=
trace_headers
,
)
else
:
engine_request
,
tokenization_kwargs
=
await
self
.
_process_inputs
(
...
...
vllm/entrypoints/openai/serving_engine.py
View file @
4d01b642
...
...
@@ -343,6 +343,7 @@ class OpenAIServing:
request_id
:
str
,
params
:
BeamSearchParams
,
lora_request
:
LoRARequest
|
None
=
None
,
trace_headers
:
Mapping
[
str
,
str
]
|
None
=
None
,
)
->
AsyncGenerator
[
RequestOutput
,
None
]:
beam_width
=
params
.
beam_width
max_tokens
=
params
.
max_tokens
...
...
@@ -437,6 +438,7 @@ class OpenAIServing:
beam_search_params
,
request_id_item
,
lora_request
=
lora_req
,
trace_headers
=
trace_headers
,
)
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment