Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
402d3783
Unverified
Commit
402d3783
authored
Jan 06, 2025
by
Cyrus Leung
Committed by
GitHub
Jan 06, 2025
Browse files
[Doc] [1/N] Reorganize Getting Started section (#11645)
Signed-off-by:
DarkLight1337
<
tlleungac@connect.ust.hk
>
parent
9e764e7b
Changes
22
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
docs/source/usage/structured_outputs.md
docs/source/usage/structured_outputs.md
+1
-1
vllm/utils.py
vllm/utils.py
+1
-1
No files found.
docs/source/usage/structured_outputs.md
View file @
402d3783
...
...
@@ -18,7 +18,7 @@ The following parameters are supported, which must be added as extra parameters:
-
`guided_whitespace_pattern`
: used to override the default whitespace pattern for guided json decoding.
-
`guided_decoding_backend`
: used to select the guided decoding backend to use.
You can see the complete list of supported parameters on the
[
OpenAI
Compatible Server
](
../serving/
openai
_
compatible
_
server
.md
)
page.
You can see the complete list of supported parameters on the
[
OpenAI
-
Compatible Server
](
#
openai
-
compatible
-
server
)
page.
Now let´s see an example for each of the cases, starting with the
`guided_choice`
, as it´s the easiest one:
...
...
vllm/utils.py
View file @
402d3783
...
...
@@ -1938,7 +1938,7 @@ def _check_multiproc_method():
"the `spawn` multiprocessing start method. Setting "
"VLLM_WORKER_MULTIPROC_METHOD to 'spawn'. "
"See https://docs.vllm.ai/en/latest/getting_started/"
"
debugg
ing.html#python-multiprocessing "
"
troubleshoot
ing.html#python-multiprocessing "
"for more information."
)
os
.
environ
[
"VLLM_WORKER_MULTIPROC_METHOD"
]
=
"spawn"
...
...
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment