Unverified Commit 402d3783 authored by Cyrus Leung's avatar Cyrus Leung Committed by GitHub
Browse files

[Doc] [1/N] Reorganize Getting Started section (#11645)


Signed-off-by: default avatarDarkLight1337 <tlleungac@connect.ust.hk>
parent 9e764e7b
...@@ -18,7 +18,7 @@ The following parameters are supported, which must be added as extra parameters: ...@@ -18,7 +18,7 @@ The following parameters are supported, which must be added as extra parameters:
- `guided_whitespace_pattern`: used to override the default whitespace pattern for guided json decoding. - `guided_whitespace_pattern`: used to override the default whitespace pattern for guided json decoding.
- `guided_decoding_backend`: used to select the guided decoding backend to use. - `guided_decoding_backend`: used to select the guided decoding backend to use.
You can see the complete list of supported parameters on the [OpenAI Compatible Server](../serving/openai_compatible_server.md) page. You can see the complete list of supported parameters on the [OpenAI-Compatible Server](#openai-compatible-server)page.
Now let´s see an example for each of the cases, starting with the `guided_choice`, as it´s the easiest one: Now let´s see an example for each of the cases, starting with the `guided_choice`, as it´s the easiest one:
......
...@@ -1938,7 +1938,7 @@ def _check_multiproc_method(): ...@@ -1938,7 +1938,7 @@ def _check_multiproc_method():
"the `spawn` multiprocessing start method. Setting " "the `spawn` multiprocessing start method. Setting "
"VLLM_WORKER_MULTIPROC_METHOD to 'spawn'. " "VLLM_WORKER_MULTIPROC_METHOD to 'spawn'. "
"See https://docs.vllm.ai/en/latest/getting_started/" "See https://docs.vllm.ai/en/latest/getting_started/"
"debugging.html#python-multiprocessing " "troubleshooting.html#python-multiprocessing "
"for more information.") "for more information.")
os.environ["VLLM_WORKER_MULTIPROC_METHOD"] = "spawn" os.environ["VLLM_WORKER_MULTIPROC_METHOD"] = "spawn"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment