Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
a8238bbd
Unverified
Commit
a8238bbd
authored
May 07, 2025
by
Aaron Pham
Committed by
GitHub
May 08, 2025
Browse files
[Chore][Doc] uses model id determined from OpenAI client (#17815)
Signed-off-by:
Aaron Pham
<
contact@aarnphm.xyz
>
parent
d43f914d
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
examples/online_serving/openai_chat_completion_structured_outputs.py
...line_serving/openai_chat_completion_structured_outputs.py
+1
-1
examples/online_serving/openai_chat_completion_structured_outputs_structural_tag.py
...enai_chat_completion_structured_outputs_structural_tag.py
+1
-1
No files found.
examples/online_serving/openai_chat_completion_structured_outputs.py
View file @
a8238bbd
...
...
@@ -138,7 +138,7 @@ def main():
api_key
=
"-"
,
)
model
=
"Qwen/Qwen2.5-3B-Instruct"
model
=
client
.
models
.
list
().
data
[
0
].
id
print
(
"Guided Choice Completion:"
)
print
(
guided_choice_completion
(
client
,
model
))
...
...
examples/online_serving/openai_chat_completion_structured_outputs_structural_tag.py
View file @
a8238bbd
...
...
@@ -59,7 +59,7 @@ and San Francisco?
}]
response
=
client
.
chat
.
completions
.
create
(
model
=
"meta-llama/Llama-3.1-8B-Instruct"
,
model
=
client
.
models
.
list
().
data
[
0
].
id
,
messages
=
messages
,
response_format
=
{
"type"
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment