Unverified Commit a8238bbd authored by Aaron Pham's avatar Aaron Pham Committed by GitHub
Browse files

[Chore][Doc] uses model id determined from OpenAI client (#17815)


Signed-off-by: default avatarAaron Pham <contact@aarnphm.xyz>
parent d43f914d
...@@ -138,7 +138,7 @@ def main(): ...@@ -138,7 +138,7 @@ def main():
api_key="-", api_key="-",
) )
model = "Qwen/Qwen2.5-3B-Instruct" model = client.models.list().data[0].id
print("Guided Choice Completion:") print("Guided Choice Completion:")
print(guided_choice_completion(client, model)) print(guided_choice_completion(client, model))
......
...@@ -59,7 +59,7 @@ and San Francisco? ...@@ -59,7 +59,7 @@ and San Francisco?
}] }]
response = client.chat.completions.create( response = client.chat.completions.create(
model="meta-llama/Llama-3.1-8B-Instruct", model=client.models.list().data[0].id,
messages=messages, messages=messages,
response_format={ response_format={
"type": "type":
......
...@@ -4,7 +4,7 @@ An example shows how to generate structured outputs from reasoning models ...@@ -4,7 +4,7 @@ An example shows how to generate structured outputs from reasoning models
like DeepSeekR1. The thinking process will not be guided by the JSON like DeepSeekR1. The thinking process will not be guided by the JSON
schema provided by the user. Only the final output will be structured. schema provided by the user. Only the final output will be structured.
To run this example, you need to start the vLLM server with the reasoning To run this example, you need to start the vLLM server with the reasoning
parser: parser:
```bash ```bash
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment